Hi, all.
I´m investigating a DF that takes very long time to complete. This DF is part of a greater Job with several others DFs.
When I run the DF in test environment, it runs smoothly and takes only few seconds!
In production, the only strange thing I see is that the monitor file is logging every record of the problematic DF´s flat file.
This is not happening for the remaining DFs in the job with other FFs.
The monitor sample rate is ok, this can be checked in other parts of the monitor file.
This DF takes the FF and branches it to two query transforms. In one calculates max(dateColum) and then merges it to filter the records (dateColumn = calculatedMaxDateColumn. Then it outputs to a DT transform with database table.
I have compared the FF settings (DF level) to others FF with no differences found.
Monitor File output (partial, showing that every row is logged):
/VC_CARGA_SOBREGIROS_DF_1/PT_Sobregiros_FF789, PROCEED, 1, 0.016, 5218.785, 0.000, 0.000, 0:5
/VC_CARGA_SOBREGIROS_DF_1/PT_Sobregiros_FF789, PROCEED, 2, 0.016, 5218.785, 0.000, 0.000, 0:5
/VC_CARGA_SOBREGIROS_DF_1/PT_Sobregiros_FF789, PROCEED, 3, 0.016, 5218.785, 0.000, 0.000, 0:5
...
...
/VC_CARGA_SOBREGIROS_DF_1/PT_Sobregiros_FF789, PROCEED, 258622, 2375.061, 7593.830, 0.000, 0.000, 0:5
/VC_CARGA_SOBREGIROS_DF_1/PT_Sobregiros_FF789, PROCEED, 258623, 2375.077, 7593.846, 0.000, 0.000, 0:5
/VC_CARGA_SOBREGIROS_DF_1/PT_Sobregiros_FF789, PROCEED, 258624, 2375.092, 7593.861, 0.000, 0.000, 0:5
The only difference found when comparing to a test run was that in production the following two lines are added in monitor file:
Thanks a lot.