So how do YouTube manage?

[Craig321]

Yes... hence why you can view it right away.

Try it on your home PC. Doesn't take that long - a few seconds in most instances - to convert a video into crappy quality flv. Now imagine a farm of high-spec servers doing it and you will start to see how they do it.

Yeah, I've been playing around with mencoder/FFMPEG (which is apparently what they use) & encoding is fairly quick.

Thinking back now I did upload a video onto YouTube the other day and it took quite a few minutes to show up.

Also, most of the YouTube videos are pretty small, so encoding them would be easy.

Now I know

Thanks,
Craig.

 

[WotDa]

...Are you?

No…

 

[Amp34]

The videos take up 45 terabytes of storage — about 5,000 home computers’ worth.

When was that article made? Thats just under 10GB by my reckoning. We had more than that 5 years ago. 45TB isn't too bad, only 45 1TB drives.

 

[Jaffa_Cake]

I'm sure they can encode faster than you can upload ( on average ) maybe its encoded whilst its being uploaded? Maybe the flash loader does it on your pc? I need to know now for my own satisfaction.

 

[Psyk]

I think crazy optimisation is the key

And highly parallel algorithms. They have a system that allows any sort of computation to be carried out on a huge batch of data simultaneously. Apparently it all boils down to having two basic commands to spread the workload.

http://en.wikipedia.org/wiki/MapReduce

 

[Ice Rich]

45 terabytes of vids, growing in a compound fashion at a rate of 20% per month!

Are you saying that there are 45 terabytes of videos on youtube?

I would have thought it would have been a load more then that.

We have 1TB drives now, its strange to think you could fit youtube onto 45 of them?!

 

[WotDa]

^ what he said.

Doesn't seem a lot tbh. Must be more than that. What I would like to know is how CERN is going to manage / store the data from the LHC. Apparently it is going to generate around 15 petabytes per year. To cap it off, its not searchable either!

Several billion dollars, and they can't make their own data searchable?

Either way, I'm sure they've got the storage sorted, servers in the tunnels 4tw.

 

[collisster]

spec me a converter for flv back to something I can use please

ta

 

[Vai]

spec me a converter for flv back to something I can use please

ta

http://vixy.net/
It can be rather slow though

 

[manoz]

spec me a converter for flv back to something I can use please

ta

You could try flv extract from here http://www.moitah.net/. I've only tried the audio function so can't really comment on the video.

 

[NokkonWud]

2.21 gigawatts of power!

 

[jellybeard999]

spec me a converter for flv back to something I can use please

ta

unplug + VLC ?

And the quality is absolutely atrocious, so it'll be less than you think. Saying that, id say it'd be a lot more than 45Tb

 

[Dunks]

2.21 gigawatts of power!

Jigawatts!

 

[lay-z-boy]

Jigawatts!

flux capacitor tbh

…Are you joking?

Clearly they use a qx6800 with stock cooling and ofc its overclockz0red for xtra 1337 speedz

 

[Energize]

Even my pc encodes video to h.264 at 150fps, I think any computer can handle 320x240 flv encodes.

 

[WotDa]

Clearly they use a qx6800 with stock cooling and ofc its overclockz0red for xtra 1337 speedz

 

[Sirrel Squirrel]

Even my pc encodes video to h.264 at 150fps, I think any computer can handle 320x240 flv encodes.

I take it thats at low res?

 

[Energize]

I take it thats at low res?

Yes 320x240, it does pal dvds around 35fps.

 

[Westyfield2]

spec me a converter for flv back to something I can use please

ta

SUPER ©

 

[Craig321]

Even my pc encodes video to h.264 at 150fps, I think any computer can handle 320x240 flv encodes.

Ooh, what program do you use to measure that?

I wanna see how fast mine goes