Batch download NZB files.

[RomanNose]

Some of you might be asking why I want to do this, the answer is simple.
I have a local nzb index running on my Lan ONLY and I wish to backfill the index from the last 2 years.
The problem is, the indexing script I am currently using does not work that well with backfilling. So I am looking for a program, no matter how old it is, no matter what operating system that can do the job of downloading the headers from Usenet and create nzb files from them.

This index is for personal use only, so don't ask if you can use it.

 

[derfderfley]

I think your problem is going to be finding something that can cope with potentially 10's of millions of headers. Most of the index programs rely on a *SQL backend, and will struggle to cope with that size of database.

 

[RomanNose]

I think your problem is going to be finding something that can cope with potentially 10's of millions of headers. Most of the index programs rely on a *SQL backend, and will struggle to cope with that size of database.

Perhaps, I could progressively do it instead of doing it all at once. It works fine for fetching new headers, it's just this backfilling which is a pain.
It is really stressing SQL though, at the moment I am sitting about 60% CPU on a dual core just from Mysql.