Hi all,
I am not new to programming but it is more of a hobby than anything for me. At the moment i am trying to work out he best way to get my applications (writtng in vb.net 2008) to load and display about 10'000 rows of data.
Now, at the moment the volume of data is approximately 5'000 however i am sure it will increase.
The data is currently stored in a text file.
This data is interigated and then loaded into the application; the problem is that a loop takes far too long. I am loading into a dataset, and this can be assigned to a data grid in the application, however, when i do that and load the data set the application takes about 4 mins and up to 1.5gb of memory.
when its finished it then clears down the 1.5gb but still runs at about 120mb, which to me seems stupid.
what is the most efficient way to get that large amount of data into the application and scrollable / viewable by the user?
i am happy to receive any suggestions on how best to store the data (if the text file isnt the best way, which I believe it isnt) and how to retrieve from the file (the quickest way) and display the data on the screen.
I am not new to programming but it is more of a hobby than anything for me. At the moment i am trying to work out he best way to get my applications (writtng in vb.net 2008) to load and display about 10'000 rows of data.
Now, at the moment the volume of data is approximately 5'000 however i am sure it will increase.
The data is currently stored in a text file.
This data is interigated and then loaded into the application; the problem is that a loop takes far too long. I am loading into a dataset, and this can be assigned to a data grid in the application, however, when i do that and load the data set the application takes about 4 mins and up to 1.5gb of memory.
when its finished it then clears down the 1.5gb but still runs at about 120mb, which to me seems stupid.
what is the most efficient way to get that large amount of data into the application and scrollable / viewable by the user?
i am happy to receive any suggestions on how best to store the data (if the text file isnt the best way, which I believe it isnt) and how to retrieve from the file (the quickest way) and display the data on the screen.