IrishNelse
New member
- Joined
- Oct 1, 2013
- Messages
- 1
- Programming Experience
- 1-3
Hi
I have 2 csv text files, 1 containing a set of results that is the file to be analysed, and a second csv file containing reference lookup data. for example file 1 (2500 rows) contains a set of measurements from an experiment and file 2 (1000 rows) contains the locations of each measurement site tabualted according to the type of material and specimen under test.
My question is, what is the best way (fastest) to read in and merge the two files. I had considered the following but would also like to know if there are other better options
1. Read both files using the Microsoft text driver and run an ADO query to merge the 2 files
2. Load both files into an in memory SQLite database and again use and ado query
3. Load both files into an array and index through the array line by line and lookup the corresponding value from the other array
Thanks
I have 2 csv text files, 1 containing a set of results that is the file to be analysed, and a second csv file containing reference lookup data. for example file 1 (2500 rows) contains a set of measurements from an experiment and file 2 (1000 rows) contains the locations of each measurement site tabualted according to the type of material and specimen under test.
My question is, what is the best way (fastest) to read in and merge the two files. I had considered the following but would also like to know if there are other better options
1. Read both files using the Microsoft text driver and run an ADO query to merge the 2 files
2. Load both files into an in memory SQLite database and again use and ado query
3. Load both files into an array and index through the array line by line and lookup the corresponding value from the other array
Thanks
