Quantcast
Channel: SCN : Unanswered Discussions - Data Services and Data Quality
Viewing all articles
Browse latest Browse all 3719

Need help in parsing flat files with dynamic column names

$
0
0

Hi guys,

 

I need your advise.  We have a requirement to read a set of flat files with dynamic column names (based on file row header) and load the same into a fixed staging table.  As an example, I can have 3 files with the following row headers below:


File 1 - NAME,ADDRESS,PHONE,GENDER

File 2 - NAME,PHONE,ADDRESS

File 3 - NAME,ADDRESS,GENDER

 

I would then need to load the above into a table with the following columns:NAME,PHONE,ADDRESS,GENDER

 

Right now, we have no idea what columns will appear except for the ones that we already have but we do know the columns that we need so we can probably setup the job to just ignore "unknown" columns.

 

Any help would be greatly appreciated.

 

Thanks!


Viewing all articles
Browse latest Browse all 3719

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>