I've got a for loop that, in sequence, downloads a number of webpages - basically it pulls a URL from a database, grabs the html using a httpwebrequest, and saves a part of it back into the database. Now over 1-10 pages this is no big deal, but upwards of 40 it starts taking a while (from one-by-one contacting the server and downloading it's contents).
This isn't a processor limiting loop, so is there a way I can speed it up by opening multiple connections at the same time?
I'm using c# and am relatively new to programming. Just a point in the right direction would be a great help.
This isn't a processor limiting loop, so is there a way I can speed it up by opening multiple connections at the same time?
I'm using c# and am relatively new to programming. Just a point in the right direction would be a great help.