Long term high capicity storage

agour

agour

agour

Associate
Joined
13 May 2013
Posts
22
Hi all,

I'm looking to change up my system to allow for my increasing storage needs.

I've currently got about 9tb+ of data, and this is growing steadily.

Right now everything is on Raid 10, and is mirrored to 2 hdd's which are rotated and stored off site.


I want to replace the internal raid 10 with a raid 5 setup to maximise speed - so I'm thinking of having using four 3tb drives to result in a 9TB useable amount.

Then have this mirror through my house to a NAS box with 9TB of storage.

Then once a month or so, take a copy of the NAS box offsite.

I'm worried about two things - one the NAS box mirroring the PC everyday (would a system only copy over new files, or would it need to rebuild everything?)

2 - how would I take a copy from the NAS box?


Any ideas, or how I could make this a better solution?

Thanks!

P.s. archived files would then be stored on 3 separate hard drives, one here, and the others living in 2 off site locations. This 9tb filesystem would only be for current projects.
 
Raid 5 won't maximise speed - it will likely be slower and is generally regarded as risky with larger capacity drives
 
Is this for personal or business?

What's the current hardware you're backing up to?
Are you using a dedicated controller for your array?

Some questions about your data:
- How are you currently doing backups?
- How much data are you backing up each day/week?
- Is that 9Tb dataset solely unique data?

Then have this mirror through my house to a NAS box with 9TB of storage.
Click to expand...
Where is the current backup target stored? Internal/external to the house?

Then once a month or so, take a copy of the NAS box offsite.
Click to expand...

Ideally you don't want to be dumping duplicated data onto whatever medium you use for offsite storage.

I think we need more information on your current backup strategy before anyone can advise on hardware/storage requirements.
 
Having a raid 5 array of 12Tb or more is a really bad idea. The typical consumer drive has a mean URE failure rate of around this size, this means if you have a drive failure it's likely you'll loose another drive during the rebuild thus loosing all data. Much better would be raid 6, however be aware rebuild times of such an array size could be in the multi day / week + range and speed will be poor during the rebuild.

Another consideration of long term storage is bit rot, overtime old files can become corrupted.

The solution I went with was a 6 drive raid 10 array using MS storage spaces formatted with REFS using 3 columns. You get good resiliency, speed and bit rot protection.
 
Ahh I didn't realise that - thanks for the heads up of raid 5 not being much faster :)

Semple - it's for business use (I'm a photographer).


Currently I have a raid 10 in my computer, and I'm taking copies of the drives every few weeks. Those drives are then stored off-site.

The 9tb is all unique data.

I think it might grow at anything from 0.3-1TB per month in future. However a lot of that data will be finished with quickly, and will then just live in long term storage.


The NAS would be stored inside the house. I could technically wire it into the garage (separate free standing building), but that's probably not a wise idea.



Now I'm wondering what is the fastest speeds I could achieve internally on my computer - maybe two 1TB SSD's in raid 1? (And a separate SSD for OS etc).

And then still have some sort of on-site NAS for larger storage and backup, and then have a copy of that off-site?

I'd love to be able to do everything over the web, but it's not feasible for me to upload 0.3-1TB of extra data each month.
 
Another thing to consider is if you want complete backups and not differential, backing up across a 1gb network even 10 TB will take days. Consider a 10 GB network or local backup to the NAS if you need it faster.
 
You must log in or register to reply here.
Back
Top Bottom