Anyone what is used to run a cloud storage operation?

sityeuropa

sityeuropa

sityeuropa

Associate
Joined
3 Oct 2014
Posts
1,780
I'm just wondering what the big companies use as storage solutions ?

Say Youtube and OneDrive, Google Drive for storing all of their data?

Obviously they will have multiple facilities worldwide each syncing with each other. But would they be using 6 TB drives for example at the end of it for storing the data?
 
I specced a 1Pb solution earlier in the year, and it was basically lots and lots of 3Tb disks, and a small amount of faster disks.

This wasn't for a cloud service though, where data speeds would be a higher priority, so I expect they have different configurations.
 
Google and Amazon S3 must have many exabytes.

wYE3DkJ.jpg


URvAy4r.jpg

Use spoiler tags if an image is over 1280x wide or resize them.
 
Yeah just lots and lots of hard drives or SSDs for the faster crowd.

A company I did some electrical work for had just shy of 20 petabyte(well that's what they said) worth of storage there were racks of just hard drives as far as the eye could see. The actual processors were contained in a separate aisle. Bit of a weird setup in my limited opinion.
 
Last edited:
Virtual server host clusters with big drives, lots of storage for the vms and separate dedicated storage solutions which are connected back to the virtual hosts. People who need a lot of storage will have racks of storage.

Google, well it would be a lot!! Huge storage farms in any data centre they operate in, over the globe
 
JBod said:
They all build their own, they don't use a mainstream vendor like EMC or Netapp. I think it is Facebook that started a opensource design kinda thing:

http://www.opencompute.org/
Click to expand...


Not true. they do use one of those providers :-)

One of the cloud companies mentioned in this thread purchased 40PB's (in one order) with one of the companies above earlier this year.

Yes they build/built their own storage and compute based on commodity hardware but this also has its challenges.
 
Last edited:
They must have storage sheds and I think it's something to do with tractors and combine harvesters as they use a farm(s).

EDIT: This book just came to mind, it's shortish stories but you should read 'The mountains of pi' story about the Chudnovsky brothers who built their own supercomputer in the 80s out of mail order parts, great read.

http://www.amazon.co.uk/Panic-Level-Cannibals-Viruses-Journeys/dp/081297560X
 
Last edited:
You must log in or register to reply here.
Back
Top Bottom