Website Ripper

[Gypo]

Basically i need to download 500 pages from a website sharpish, the software needs to be able to use a user/pass to acess the site and possible have the ability to use a proxy also.

The website in question is a large database and you can search it as a whole, or by category.

I have tried things like HTTracker and the firefox addon 'downloadthemall' but they dont do the job.

Any help would be great.

 

[Pho]

wget?

Guide: http://fosswire.com/post/2008/04/create-a-mirror-of-a-website-with-wget/

You can add username/passwords with --user=usr--password='pwd'

 

[Gypo]

Tried Wget as you said, getting connection refused though.

Problem also is that the website returns the following URL no matter what you search the DB for 'list.php'