Building a budget render farm - Got a *few* Qs

Associate
Joined
14 Jan 2010
Posts
798
Location
Dover, Kent
Hi chaps, I am currently in plans to build a small budget render farm to increase my productivity. I've got a few questions but basically if I explain everything on my mind about this build and my current plans, I am hoping someone could perhaps point out if i have missed anything or if anything is wrong or could be improved upon, thanks!

Here's a quick rundown of my setup right now: I am using a 27" iMac to do my work on, and doing 3D in Cinema 4D and also doing lots of work in After Effects, so these are the two bits of software that I would like to have my render farm work on. I do also use vray4c4d sometimes, not sure if that requires a different bit of software on the render farm to render with so thought I would also mention that.

I currently have my server case, which is a Helmer unit from Ikea which fits micro-ATX boards perfectly. I am currently thinking and planning the hardware layout inside each drawer, but currently considering mounting the PSU to the back of each drawer on the outside to allow more breathing room for the motherboard, so I can also place fans into the drawers for better cooling.

Other people have gone a different route, putting everything inside but I am worried that this way is perhaps too cramped and won't be able to give ample cooling. Here are a few photos from other people's builds:

031609_sz_helmer3.jpg


031609_sz_helmer4.jpg


031609_sz_helmer.jpg

From this website here: http://www.apartmenttherapy.com/24core-linux-cluster-in-30-ike-79331

or the famous Helmer build which actually completely disregards the drawers and just uses plexiglass resting on the runners which has the motherboard mounted to it, with the PSU mounted to the back of the case.

9-natag-i-lada.JPG


19-helmer-klar.JPG

From this website here: http://helmer.sfe.se/

Now that one I am not too keen on, as frankly I want to make this a neat build and not have any mess so more like the first build I mentioned.


Here's a crappy iPad photo of my case as it is in it's stock state:
4fbeb9fb43cbc.jpg



Now because I am building on a budget I have a problem. Right now my plans include adding a hard drive to each node, but this is obviously expensive so I was wondering if for a render farm it is possible to run nodes without any hard drives, and all of them run off like a base computer with hard drives attached. The computer beside it in the photo is my "gaming PC", but I could always add hard drives to it or in fact just use the ones I have in there right now and perhaps use that as the base for the server. That would save me a nice bit of space in each drawer and also save me money that could either just be saved or perhaps go into other areas that might need a bit more spending on it.

The next problem is now choosing what I want in it. I have given myself three (rather similar priced) options to go for here and they are an i5-2500k, an i7-2600k, or the new AMD Bulldozer FX-8150.

Here is all the items I've looked at on the overclockers shop:
4fc03e36f3d8c.jpg


Both the PSUs are there as I couldn't figure out if the OCZ one would be worth the extra, and I picked that hybrid drive as it didn't seem that much more than the other drives and seemed to offer faster speeds, but then I am not sure if it would be utilized well on a server.

The other thing is I am guessing that GPU rendering is not readily available for the software I use so am I right to just ignore this exists and go down the CPU route?

So what do you guys think? Would the extra cores of the 8150 be worth it considering it's only a bit more expensive than the i5? Benchmarks I've seen have said yes at least when running Cinebench, but the i7 did prevail in all tests I've seen but not sure if I can dish the extra cash or whether the extra cash is worth it.

Right now I am looking to build just two nodes and will add more nodes when I have more money to play around with.

Thanks for reading and sorry for the scattered writing. Thinking about this is giving me a headache!
Cheers
 
Last edited:
Hey guys, I'm wondering since there are no replies did I perhaps place this in the wrong forum?

Still really can't make my mind up and need a few differing opinions to help me make my decision as to what hardware to buy at least.

Any help would be greatly appreciated thanks!
 
I don't have like a set budget, but you can kinda get the idea of how much I want to spend on each judging by the choices I've set out already.

For the most expensive setup out of what I've put down it's about £400 per node, but less than that would be awesome. If I am able to do the idea about me running each node as driveless and running off a main computer with drives attached to it that would bring my budget down too.

Also not sure what you mean by wanting to keep the cases small. Each draw can fit a micro-atx board, a power supply unit and really only fit in a laptop sized HDD.
 
Last edited:
How about....

Supermicro X9SCL-F motherboards (mATX, C202 chipset)
Intel E3-1230 processor (4 cores/8 threads)
Supermicro 1U heatsink (SNK-P0046P)
ECC ram (up to 32GB)
SFX (Silverstone ST40F-ES for example)
Boot via PXE
Storage via iSCSI

You'll need a PXE server but can just use a mitx or atom unit and an iSCSI server but there are a few guides out there for free versions. The motherboards have IPMI and KVMoIP so you can control everything over IP including the BIOS of each node. You'll need some decent cooling but the PSU height is only 86mm so maybe 100mm gap between board will give you a nice high density pack per draw

you'll also need to confirm connections on the PSU and motherboard.

Info on PXE booting here.

RB
 
Thanks for the hardware suggestions. Firstly RimBlock: Everything you've mentioned has just gone right over my head I'm afraid. This is my first foray into servers, and I am more of a creative arts guy than a proper tech head. I can't seem to find much detail on buying all the bits you've suggested. I was kind of just hoping to grab everything I need from the overclockers shop as it's nice and easy.

The simplified suggestions posted above by Jamesfreddie seem really good to me though! Thanks for that, I didn't even think to look at Ivybridge stuff as I thought it would be more expensive. Do you think it would be more worth the little bit extra to get a 3570K over the 3450? http://www.overclockers.co.uk/showproduct.php?prodid=CP-418-IN&groupid=701&catid=6&subcat=567

From the benchmarks I've seen, I am seriously budging towards it. Because I have free delivery, changing to the 3750K brings my grand total up to £312.85.

Will the 350w of the PSU be enough? I've always been a bit wary buying lower powered PSUs, but I guess as the architecture has become so much more efficient these days I should no longer be worrying about these things, right?

Oh also wondering as I've looked around everywhere and found nothing, is there a simple way to post my checkout options on the forum in the same formatting as you have done? I keep seeing it like that so guessing there is a button somewhere to generate it but I can't seem to find it.

Cheers
 
I wouldn't bother with the 3570K as you can't overclock with the motherboard any way.

The 350W is enough.

The CPU only draws 77W max. So overall the machine would pull 110W from the PSU MAX.
 
I wouldn't bother with the 3570K as you can't overclock with the motherboard any way.

The 350W is enough.

The CPU only draws 77W max. So overall the machine would pull 110W from the PSU MAX.

I wasn't really planning for overclocking. I'm not really confident enough in that.

So out of the 3450, 3550 and 3570K which would you say is best? I don't mind paying the bit extra for the boost in performance.
 
I wasn't really planning for overclocking. I'm not really confident enough in that.

So out of the 3450, 3550 and 3570K which would you say is best? I don't mind paying the bit extra for the boost in performance.

The best is the 3570K as you can overclock it and has HD4000 graphics.

For what you are doing i would just go with a i5 3450.
 
Thanks for the hardware suggestions. Firstly RimBlock: Everything you've mentioned has just gone right over my head I'm afraid. This is my first foray into servers, and I am more of a creative arts guy than a proper tech head. I can't seem to find much detail on buying all the bits you've suggested. I was kind of just hoping to grab everything I need from the overclockers shop as it's nice and easy.

A bit late as you have already purchased but;
X9SCM-F (the SCL does not seem so easy to find in the UK, the SCM is easily available): 180
Intel E3-1230 Xeon cpu: 177
8GB ECC ram (2x4GB): 36
SFX 80% cpu: 45
Total: 438 GBP

Advantages: 3 lan ports (one for remote management), ability to control the machine via remote application so no need for keyboard/mouse (including access to the machines BIOS on boot). ECC ram give 1bit error correction to help catch and correct errors that may occur in ram. The E3 Xeon has the same number of cores and threads as the i7 at a cheaper cost and less power, only needs 1-3 network cables connected for full access and control via free IPMI applications. Smaller PSU so space saving. Server grade hardware.

Disadvantages: 100 GBP more than your suggested bottom i7 parts.

PXE: PXE allows you to boot your OS from another machine (no local OS installed). This is one of the things you mentioned.

iSCSI: allows you to attach hard drives in another machine to your machine via the network as if they were directly attached to your machine.

One network port on the motherboard could be dedicated for the storage network (SAN via iSCSI). The other could be used for standard network traffic.

You would need a machine holding all the hard drives and running some freeware iSCSI software and a machine for sharing out the operating system images for PXE. There are lots of guides out on the internet for setting this lot up and the hardware requirements for these are not so high. One big advantage is the ability to add a new node easily, not have to install an OS and have it up and running very quickly.

Couple of sample guides;

Personally if I was to do this on a budget, I would do the following;
Phase 1: 2x the Supermicro builds above, add a hard drive to each machine, install the OS and get them working as nodes.
Phase 2: Get another MB/CPU with lots of network ports (A Supermicro X9SCi-LN4-F & i3-2120 for example), add the hard drives and set as a PXE server and iSCSI server. Add a decent switch with link aggregation (combining multiple network ports to make one big network connection) like the HP 1810G-8/24 (8/24 ports receptively).

Phase 3: Add more Supermicro nodes as needed.


Note the prices were taken from a competitor site and so there are no links. The prices are not necessarily the best as I didn't search around.



RB
 
A bit late as you have already purchased but;
X9SCM-F (the SCL does not seem so easy to find in the UK, the SCM is easily available): 180
Intel E3-1230 Xeon cpu: 177
8GB ECC ram (2x4GB): 36
SFX 80% cpu: 45
Total: 438 GBP

Advantages: 3 lan ports (one for remote management), ability to control the machine via remote application so no need for keyboard/mouse (including access to the machines BIOS on boot).

RB

You can't do remote management with E3-1230 and vPro because there is no graphics card. You would need a 1235 or i5 2500
 
You can't do remote management with E3-1230 and vPro because there is no graphics card. You would need a 1235 or i5 2500

The X9SCM-F board has the Nuvoton WPCM450RA0BX BMC and Matrox G200 onboard graphics hence the recommendation from Supermicro to use a CPU with no onboard graphics. It also has IPMI and KVM over IP (as denoted by the -F on the model name) which means via Supermicros IPMI viewer (free download from their site) you can remotely control the machine from turning it on to going through the BIOS and changing options to watching the OS booting to using the machine as if you were on a keyboard, mouse and monitor in front of it.

I do so regularly with the two machines based around the X9SCM-F and E3-1230 processors I have at home.

I don't really see the need for vPro for remote management when you have IPMI 2.0 and KVMoIP.

RB
 
Back
Top Bottom