Hi ,
We are using CDC on Sybase ASE database in SAP Data Services. Here we are loading data into the Sybase IQ.
We are using the Sybase Replication server with Power designer option to implement the CDC.
We successfully configured the Replication server and CDC working properly.
But we have one issue as per our requirement.
We are planning to use CDC like near real time . We need to run the job multiple times per day . We may get bulk changes in the source transactions in the month end as it is banking sector.
When we are using Power designer CDC, in the back ground it is using the procedure to delete the CDC data based on the DS_CHANGE_RETENTION. Default is 5 days . In the procedure it runs once per day (8 AM to 8 AM) and after 5 days CDC table data will be deleted .
We should have control on Retention period like multiple times per day . We should not delete till certain period. If I am not deleting the data and I am running the job multiple times per day it is trying to insert old CDC data again and we will get primary key violation.
If we have any flag in the CDC table and possible to mark the flag in the CDC database table once we load the CDC record in to the target, some how we can maintain the CDC data for few days per requirement and can run multiple times per day as non marked flag records will be loaded into the target.
I cannot use Sybase replication server with continuous workflow method as we cannot store CDC data in intermediate database CDC tables . We cannot define the stop process for workflow as stop process may change depend on requirement often . That's why we opted Power designer option for CDC.
Could you please help me to resolve this issue. Any good approach for this requirement.
Thanks & Regards,
Ramana.