Need some help with planning my storage

Associate
Joined
1 Dec 2005
Posts
803
I'm asking here since this is less about specific drives and more about the big picture and the best way to use resources, which hopefully you enterprise chaps will know like the back of your hand ;)

Ok, here's the situation.

I've got a server currently with lots of drives in it, 6x1tb of which form my storage pool but there's no redundancy, they are just separate disks with separate shares that I consolidate on my workstation as a few Windows 7 Libraries. On these drives I basically just have TV and movies that I want to keep, so it's not that big of a deal if I lose a drive right now since the data that goes is isolated and can be 'found' again if necessary.

There's also about 500gb on another disk that gets used as backup for my workstation and a few other systems.

My workstation has a RAID0 set of 2x500gb drives. I did this to help improve video editing speed and figured the risk of failure was mitigated since all the important stuff was backed up daily to the 500gb area on the server.

HOWEVER - the storage I use for TV/movies etc is now down to about 800gb free, spread across 6 drives. The chassis I'm using is full both in terms of physical space to mount drives as well as motherboard SATA headers and PCIe headers to run SATA controllers (there are 2 in there at the moment). My workstation (and consequently the backup area) is also nearly full.

Although I have good backups of my important data, I'm becoming increasingly concerned about the time and effort it would take to recover from a failure of the array in my workstation so I want to move away from that. I also want to speed up the video editing situation which is more often than not disk limited.

So. I've got about £1500 that I can justify spending on this, but the less the better. I want to use an SSD in my workstation for the OS, programs and games (about 240-256gb will do). From there I could use another SSD for my profile, docs etc (backed up daily) and as a working area for video projects, which could be archived off to the storage pool once I'm done.

The disadvantage of this, from the editing point of view, is that sometimes I like to mix footage from several different projects which could cause me to run out of space on this working area if I had to move the footage out of the slow network archive to work with it.

So the other option is to build an array on the network that will pump out 300/400/500mb/s and connect over 10G or Infiniband (probably the latter since it's much cheaper at the moment). Whether or not I use this array for the TV/movies as well as my backups AND active working data, I don't know. I'd feel nervous if there's only ever one copy of my important stuff, even if it's on a RAID10 array, so do need to consider an additional disk (or mirror) purely for file-copy backups (but this probably only needs to be 20-25% the size of the storage pool).

I've spent WAY too long thinking about all of this (probably over thinking to be honest) and have put off doing anything about it for probably 12 months now. I'd like something rack-mountable that will eventually sit in a rack in the garage along with some other bits and pieces. Things like the connectivity aspect are slightly lower priority since 1000mbps isn't too bad for the short term. But considerations for drives (size and quantity), arrangement (do I even want RAID?), controller card(s)... it's bewildering.

HELP!! :p
 
Digest of the post:
Current server: 6 x 1TB disks, no RAID. 800GB free space remaining across all drives. Chassis is full, no additional room for disks. Currently full of TV episodes and movies, nothing unique.
Current workstation: 2 x 500GB, RAID0. Used for video editing, occasionally backed up to standalone 500GB disk.

Needs:
Access to a large, fast storage array over network for editing and selecting videos from archive. 10GbE considered.
Wants:
Rack mounted. Large enough storage for the TVs and movies, as well as Backup & Working data. Preferably RAID more resilient than RAID10.
Budget: £1500




My thoughts would be to separate this into two separate tasks completely.
Your workstation is where you process the data, so you don't want to keep much on there.
Something like:
Xeon E3 or Dual socket E5 workstation, with GPU acceleration if your editing suite supports it, plenty of RAM (16GB? 32GB? More?), RAID1 256GB SSDs for your OS and binaries.
Once this is sorted, you can start looking at your storage.

For that kind of money, you'd not going to be able to get an off-the-shelf solution.
How much storage do you need?
10GbE is doable, but you will have to live with a single link between your workstation and the server. The very cheapest 10GbE capable switch is at least £1700 or so (off the top of my head) without any kind of management.

Honestly, I don't think £1500 is going to cover workstation AND storage [Edit: in two separate boxes], but maybe other posters can suggest something.
 
Last edited:
how about build a new server with 2 or 3TB drives...spec case to hold 8 Drives, raid controller etc...

Then could you use the 1Tb and a GOOD raid card in your workstation...build raid for speed.....

might not be the best solution, but I think fit into budget?

GJUK
 
occasionally backed up

Daily ;)

But otherwise, that's the gist of it. My workstation is ok power wise (Phenom 965, 16Gb) but scrubbing through footage is usually a pain because the disk can't keep up. Even a single SSD (as opposed to a RAID stripe) is going to be double the performance I have now which is probably going to be enough. I'm keen to avoid RAID0 on my workstation as sorting it out when it fails is too much of a headache (even with good backups).

In terms of how much storage - well at least 8tb since that covers me for what I have now plus a decent amount of expansion for the next 12 months or so. But if I want to keep everything on that storage pool, then 12tb+ would be my preferance.

I'm not sure there is anything faster and more resiliant than RAID10 at this level? I'm leaning away from RAID5 due to the issues with rebuilds on large arrays with large disks, and the write performance is going to take a big hit. I think it could be easier to expand the array in the future with RAID10 too?

4x3tb in RAID5 is within budget I think, but the rebuild times and risk of a second failure... it's crazy. That's the best gb-per-£ as well so mitigating the risk with a larger quantity of smaller drives would be a frustraiting spend of the money!

I've been looking at off the shelf stuff but I'd definitely get more value from a custom build I think. The system would be running Server 2008R2 and doing other things as well as just serving files, much like the current server does various things.

The network connectivity is an interesting one. 10Gbe would be great but the adapters are still a significant cost. Infiniband on the other hand, while slightly more hassle to setup initially, offers some serious bandwidth (900mb/s+) for quite a small investment. Since it's only ever going to be a machine-to-machine link, it should do the job nicely. But this aspect of the build can wait, the important bit is getting the storage right.

Then could you use the 1Tb and a GOOD raid card in your workstation...build raid for speed.....

Not a bad idea there (always good to recycle!). However, as mentioned I'm keen to avoid RAID on my workstation (unless it's a mirror, which I don't think is really necessary) because of the time to set it all up again after a failure. I appreciate that if a single drive failed it would take much the same time to set it up again, but obviously the risk of a RAID failure is much higher.

The second thing is that I don't want a raft of mechanical drives in my workstation due to the noise and the heat. Having a single pair is fine, but a couple of nice silent SSDs would be lovely :)


Ok - so I hear you on the 'might not be able to do both' aspect. The most important thing is the server and storage in it since that's the most expensive bit and if I don't do it now then the pot of money will end up going on some shiny bits for the Caterham instead :o

Thanks for the input so far :)
 
Is this video editing for work or a hobby?
Do you use the TV / Movies for your editing, or is that just something incidental you mentioned?

For the TV / Movies, get any box, get a bunch of 2TB / 3TB disks and put them in RAID6+Hotspare until you have enough capacity. Rebuild times will suck when the array starts to get full but the read performance will be just fine.
 
It's all hobby stuff at the moment, and the TV/movie files aren't used for editing.

So is that suggestion a result of it being too expensive to cover all bases with an array at this kind of price level?
 
Back
Top Bottom