Best backup solutions?

Cuchulain

Cuchulain

Cuchulain

Soldato
Joined
28 Dec 2004
Posts
7,620
Location
Derry
I've got a dedicated server running qmail with around 3000 users who in total have around 1.8million emails stored, around 500gb of data. I'm trying to find the fastest way to back these up nightly to Amazon S3 and I'm losing the will to live now!

I've tried gzipping them all up in to a single tarball which I could then upload to s3 with aws tools but over 24 hours later it was still running so a daily backup wouldn't be possible. I've tried s3 tools to do one full backup and incremental but it appears it takes the same amount of time to just stat the files for upload. I've tried mounting S3 with fuse but it's even slower and flakey at best as it keeps losing the S3 bucket credentials somehow. I've now resorting to just tarring everything in to one uncompressed file and then uploading it with aws, 6 hours approx to tar every file and then however long it's going to take to upload.

Is there any easier/faster solution?
 
When backing anything up, I usually just drag and drop, scp or git (for dot files) to my server or github account (home user, not dealing with the volume you are).

But in most Reddit threads I read on the Linux subreddit, Rsync is usually the bandied about method of performing backups. I haven't used it though.

A quick google returns: http://www.qmailwiki.org/Backup and Rsync is mentioned at the bottom.
 
been looking into stuff for work. there's a free 'enterprise ready' linux backup solution called bacula that might be worth a look. We didn't progress with it in the end and stuck with our paid solution, but i seem to remember linux & cloud support were there for it.

Nox
 
You must log in or register to reply here.
Back
Top Bottom