Download folder from url

[brotherkennyh]

Hi,

I want to be able to download the files from 'http://www.website.com/folder' to a network location '\\ServerName\SharedFolder\'

I have been searching for a good way to do this. Some example seem to create a list of files at the specified location and then loop through the list downloading the files one by one.
Is that the best way to do this or is there a simpler way to do it?

Could someone point me to a good example somewhere?

Cheers

Kenny

 

[big.nerd]

brotherkennyh,

I can speak for Python - to which I have done this; generally speaking you are best to create a list of files then loop.

One of the primary reasons for that is the potential need to filter files based on type, date, etc.

If you are just looking to scrape an entire website, you may have better luck using a command-line capable utility such as HTTrack - which is an Open Source website downloader - I am not endorsing this product, it's just one that I am familiar with.

Depending on what you are trying to achieve with your application - you may find it to be easier to just execute httrack from within your application, the application itself is already multi-threaded, very configurable and mature.