Quantcast
Channel: SCN : Unanswered Discussions - Data Services and Data Quality
Viewing all articles
Browse latest Browse all 3719

Big File loading

$
0
0

Hi everyone,

 

 

We are running a POC using Data Services with Oracle.

Customer gave us a 70 Gb data extract of the central transaction table.

 

We are facing issues with the Oracle loading.We managed to load the file as it is in oracle ( ODS part)

But when it comes to operate transforms (DWH part) we run into crazy duration ( 3 days + )

 

The CSV files contains 200 000 000 records.

 

Do you have any hints on how improve performance ?

 

We can't work on the hardware part, so we must work on Data Services & oracles sides.

 

Any help apreciated

 

Thanks !

 

Guillaume


Viewing all articles
Browse latest Browse all 3719

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>