This query is regarding View Design-Time Data functionality.
Do we have any limitation on 'Number of rows to read from source when filtered ' option - in case we have huge source table in transform. Is the data read based on the keys in ascending/descending order ?
Also, when I use date based conditions in where clause, seems it is not working for 'View Design time Data' functionality. However,with Job execution data is being fetched for the the same date conditions applied in where clause.
My source table has 20 Million records (dating from last 10 years), and filters applied on most recent dates. It might be that this data did not even gets read from source for the design time data.
Currently, it is not allowing me to set Current Row fetch size > 1 Million
Regards,
Rv