Hi guys
i have very general question to ask...
presently i have dataflow which has one source table connects to query transform and further query transform connects with target table.. query transform has no filter, no order, no group by ... it is simple select * from source table ......... company where the source tables resides have given us their odbc driver to connect and extract same data... but it takes very long time to copy at our end.. i admit that data is more than 100 million (takes more than 4 hrs) records.. but could you please help me to debug what can be done to increase the performance and how can i check why it takes very long time...
ODBC connection set up in administrative tools->ODBC application.. is there any other way to set up the odbc....
when i run same query on the tool provided by them to connect with LIVE system.. it takes half of the time taken by data services to copy..
I have tried changing the dataflow properties between in-memory/ pageable with degree of parallelism.
what can i check on my end if anything wrong going at my end... before i tell anything to source company to see...
I would be very greatful if anyone can help me to understand same.
regards