Application Hangs when reading large amount of data from SQL Server

[umnex]

Hi,

I have created an application in vb.net 2005 that creates a CSV file from a table in SQL Server. The application works fine when several hundred records are exported but when I try to export a table with 99000 records, The application hangs and displays "Not Responding". Any help in this regard would be highly appreciated. Thanks.

 

[Bob Langlade]

You should try using a second process for importing and converting your data to csv. It is not unusual for your application, to show "Not responding" if the main process is using all your processor power.

 

[TechGnome]

Why are people amazed that this happens? Tell me, would it take you longer to read a book that's 99000 pages, vs on that is only a couple of hundred pages? Of course it would! Same thing with databases (any kind)... it takes time to read that much data.

1) First thing to do is to question "Do you *REALLY* need that many records? I mean, REALLY NEED all those records?
2) Secondly, since it is a time consuming process, Bob's onto something there, you should spin off the process into it's own thread and report back after it's done.

-tg

 

[umnex]

Thanks

Thanks. I've got the idea.