building a new work station for processing a vast amount of mobile mapping data

R9mpo

R9mpo

R9mpo

Associate
Joined
25 Sep 2017
Posts
140
hello,

looking for a little help.

I am looking to build a PC with as much power as possible. it will soley be used for processing a very vast amount of mobile mapping data.

My original thought was to go for something like a threadripper 16 cores or a i9 equivelent.
64/128gb of ram
1080ti or titan XP?

But am i best off with something like xeon?
Graphics card wise the company recommend a quadro graphics card which is best/ most cost effective?

i would like to go with a large super fast SSD of 1tb minimum.

and look for a internal drive of 8-10tb.

any help would be appreciated as i need to build this PC / work station ASAP.
 
Pix4d, leica Pegasus mobile mapping software etc

orbitalwalsh said:
What software would be used ?
Might help with research to see what is best with your cash
Could be the case of GPU compute power being stronger then any core CPU or the other way around .
Hate to speak solid pieces on both to find out one isn't utilised as much or at all to the other
Click to expand...
 
Th
orbitalwalsh said:
did some digging !

Direct from Pix4d site - recommended specs



in relation to GPU or CUDA Support


https://support.pix4d.com/hc/en-us/articles/203405619



Testing!

Shows Intel trumps AMD, latest 8700k matches Thread ripper! so guessing core speed and IPC plays a strong part!

https://www.pugetsystems.com/recommended/Recommended-Systems-for-Pix4D-207/Hardware-Recommendations

GPUs! Quadro isn't as fast as Geforce consumer cards- seems GTX 1060 will be fine for this build but if you want the best then 1080ti
wonder if you can SLi them ?

****maybe not


https://www.pugetsystems.com/labs/articles/Pix4D-GPU-Comparison-GeForce-Titan-and-Quadro-1085/

and your spec list is a rare one and BENEFITS from NVMe drive!!!



Funny, for one program, that company that mentioned Quadro card- it would perform 3x slower then a geforce card!

Also, as mention for XEON , So stick to z370/x299 if you can


Now, for members to help with above info- whats your max budget?
Click to expand...
Thank you for your help!
Max budget would be 3.5-4k
Would need a Tb of SSD and 4tb HDD
 
orbitalwalsh said:
SSD for OS and other apps
1tb NVMe SSD drive for your two key software
4TB HDD
14 cores with cooler to overclock it ! Remember speed counts !!!!
Gtx 1080ti
Gigabyte for UK RMA and support
64GB of ram at the top scale of work
Damn good PSU , 1080ti normally needs 650w but you'll be powering that 14 core chip and will use power when overclocked

My basket at Overclockers UK:
Total: £4,009.54 (includes shipping: £14.70)


Toning some of the parts down and dropping to gtx 1080 lands you 18 core i9 monster

My basket at Overclockers UK:
Total: £4,021.50 (includes shipping: £14.70)
​
Click to expand...
That's amazing .going to try and push for the better i9 and gtx1080ti too I think
 
edscdk said:
Before dropping 1k on a cpu check the software supports it! If the Intel 6 Core can match a 12 or 18 core tr it would suggest to me the software hates amd or cannot use that many cores..
Click to expand...
We currently run Ryzen 7 1700x
64 gb ram
Rx480
500gb SSD
2tb HDD
650w PSU

They out perform our older i7s we have and they are only 4c 4t I believe
 
orbitalwalsh said:
done a few silent loops now, silence is bliss. Eisbaer LT handles the 8700k perfectly but as you say this core will push higher as well as cause higher noise. Seems they havent put Pure wing Fans on the LT series, only the Stand Eisbaer and Silent loops have them .

weird not quoting Thread Ripper, but nice for a change. will have to dig deeper into that other program

jesus, been reading up on processing taking days! @R9mpo whats the longest its taken using Pix4d for a given work ? and what was it done with ?

also, do you know how many given photo's and at what resolution do you use for a high workload task?
seems lot of Pix4d users use Agisoft Ram calculator to work out how much ram they my require as its the nearest program to base off, pix4d dont state much .
but given rule is 64GB of ram

http://www.agisoft.com/pdf/tips_and_tricks/PhotoScan_Memory_Requirements.pdf

also changed above spec to allow Gigabyte Aorus card instead of basic gigabyte card , for heat and sound...

seeing some peoples builds with 512gb of ram and triple 1080Ti's even though return is poor for multicard set up - knocks hours of total work time due to the massive scale of the task..

just had to update list, specially on PSU Wattage! insane! this PC might run crysis
Click to expand...

we have had a few projects that have taken days around 4-5000 photos at 12mp. sometimes we use a drone that has a 36mp sensor so it will up at time but the photo count will be much lower.
that was done with the above system r7 1700x 64gb ram rx480 etc.

a normal project is around 1-2000 photos dependent if it split into smaller sections for post processing.
 
orbitalwalsh said:
***heads up, looks like Pix4d doesn't support AMD cards - only GPUs with Cuda cores - might be worth sticking a gtx 1060 in that and selling the card to a miner :)

The list I created is the best I could come up with using your budget - look like ram could be slightly over .. not sure if your able to use task manager to see max ram you used on the above work but you could think of it this way- you now have a far more powerful machine with more ram so in theory you could 32MP sensor with 5k photo limit!
seems from research intel 6 core 8700k is faster then Ryzen 8 core so this 14 core monster overclocked should fly! again stress key the point of over clocking it! doesn't have to be extreme but getting all cores to at least 4GHz, which should be straight forward and easy to do is key to getting the best out of it and your money back!
on a side note- hope you've also got that 1700x clocked to 4.9ghz all cores with 3200hz ram!




deals change roughly 12pm today (every wednesday ) - also worth trying if you do order from OCUK to blag free shipping ;)

hope all the above info has helped - certainly a different animal all together and honestly first machine i've quoted that actually needs i9 core and NVMe drive!

I have 2TB of samsung NVMe just wasted on games haha

was really surprising to see thread ripper beaten by i9 to be honest, normally with mainstream ryzen vs coffeelake its down to programs being optimised for intel like Photoshop but seems your programs are just about blunt power and speed!

just so you have a full spread, thread ripper version - which is cheaper- everything else left the same

My basket at Overclockers UK:
Total: £3,708.57 (includes shipping: £14.70)


least with Ryzen platform - you should have a better upgrade path - x499 is coming Q4 along with Thread ripper refresh which should offer increased speed and ram speeds- then year after or 2020 you'll have Zen 2 Thread Ripper which should be an animal .
ideally you';d want to pair the above with 3400/3600 ram for future CPUs are getting best performance but then costs rise to match intel or higher .

but least you have both versions, and should see good returns over current Ryzen 1700X system

Tried getting i9 7980xe as seems that would have more of an impact then gtx 1080ti over 1080/70ti in terms of performance to price - just overshoots


DE
My basket at Overclockers UK:
Total: £4,139.54 (includes shipping: £14.70)
​
Click to expand...

i think we are going to go with the 14core i9 64gb ram with 1080ti. obviously with the recommended hard drives.

We dont currently have a our ryzen overclocked and i dont think we are running high speed Ram either.
 
orbitalwalsh said:
Nice ! Well that ram should drop in the Ryzen so you'll be able to see your self just running higher spec - up to ,3200hz can make a big impact with AMD CPUs. Gaming it's 5-10fps from 2133hz default but with workstation loads, it's a lot !
Worth a try in your spare time. I know the 1700x can do 3.8ghz with its auto overclock but it might not hold it when under load, manual overclock should be able to do 3.9ghz across all cores all the time with a decent cooler

But seems that RX card won't help your current system at all :(

Let us know how you get on . Very cool program , different researching something like that

Limits will probably be the PSU, if it was 18 core then you'd be on the limit for 4.5ghz OC , 14 core should pull 50-80w less . But yeah should hit 4.4ghz OC with that core without meltdown and needing a nuclear plant

Not sure if your going through company/vat registered . Should be able to call OCUK and go through business and vat off ?
Is a way to config basket to take VAT off if that's the case .
Click to expand...
Yup all through business .
Just wanted to say a huge thank for your help! It honestly has made such a difference and pointed us In the right direction.

We will be ordering after Easter weekend so will see how it goes
 
orbitalwalsh said:
Been checking through .lot of reviews builds and bench, 14 core is indeed the best, kept the 1080ti.. doesn't make to much difference over 1080 but in more cases of workloads , it's effected performance greater then the 18 core monster ! Also the second program listed , very few articles , seems more heavy on Cuda cores...

So, with further research, dropping to 14 core instead of 18, shouldn't notice to much difference in performance across all stages.
Gtx 1080ti so you can get max 60-70% boost at stage 1. *aorus card added - for heat and sound, and higher power phase count! again speed is key and should hold its OC for long periods.
Stage 3, listed second from top Samsung NVMe, this is retail drive so there are drivers for better support then using Intel's as well as faster times, seems you'll gain max 10% boost and reading everywhere , stage 3 is all about storage speed .
Ram also taken a slight step in speed, with core speed and Cashe speed overclock should gain the benifit, unlike gaming were it doesn't do much .
Silent case ! Silent beefy cooling !
Also, PSU got an upgrade * MORE WATTS! higher quality. 12 year warranty!

***sorry just redid this 2pm- underestimated the power draw of i9s when overclocked! 350w maybe for that chip at 4.4ghz

@R9mpo
My basket at Overclockers UK:
Total: £4,070.54 (includes shipping: £14.70)


Should OC to 4.5ghz nicely without overloading the VRM and producing to much heat its self. board vrm cooling one of the best so should be covered .
Again, to get the best for your system, you'll need to overclock it ! As if not, Thread Ripper looks more attractive for pricing
Wished again could have kept the Gigabyte card for RMA, but that price is a steal !
***added the Gigabyte card- for £4k- you want the best RMA as a just in case​
Click to expand...
do i really need the 1300w power supply?
 
orbitalwalsh said:
YES!

If your not overclocking then you can get away with smaller unit....

just for a heads up. the 18 core 7980xe uses something like 500w Overclocked to 4.5Ghz

again to get the max from your chip and they OC so well! get the big power unit!

to be fair, with a decent unit- might be able to pull lower! just didnt want to under spec- not with this amount of case!

Seems prices have gone up slightly.... end of sales (Aorus 1080TI GTX)

could go 1000w to bring close to £4k mark . just keep eye out when hitting above 4.1ghz overclock to all cores with a watt meter at the wall, when system is under full load.
should help you adjust overclock higher or lower

My basket at Overclockers UK:
Total: £4,004.54 (includes shipping: £14.70)
​
Click to expand...
perfect thanks,

would you recommend these over the others HDD?
https://www.overclockers.co.uk/seag...assassins-creed-pc-st4000dm006-hd-37y-se.html
 
orbitalwalsh said:
YES!

If your not overclocking then you can get away with smaller unit....

just for a heads up. the 18 core 7980xe uses something like 500w Overclocked to 4.5Ghz

again to get the max from your chip and they OC so well! get the big power unit!

to be fair, with a decent unit- might be able to pull lower! just didnt want to under spec- not with this amount of case!

Seems prices have gone up slightly.... end of sales (Aorus 1080TI GTX)

could go 1000w to bring close to £4k mark . just keep eye out when hitting above 4.1ghz overclock to all cores with a watt meter at the wall, when system is under full load.
should help you adjust overclock higher or lower

My basket at Overclockers UK:
Total: £4,004.54 (includes shipping: £14.70)
​
Click to expand...
also any benefit with higher speed ram?
 
orbitalwalsh said:
if you can afford it and plus you get a free game then yes- wouldnt effect your work load as they'll be done off the NVMe drive, but when you move the finished article into storage, to load it up or other assets will be a little quicker .

seems from your work/program - you'll have all the images on the NVMe- run your program which is installed on the NVMe and finished article will then be on that drive and can be moved across for storage - along with the images if you wish to keep.



hard to dig up, but generally yes with workstations - just due to the amount of data and images you'll be pulling through to feed a very fast and large thread CPU . question is - is it worth the cost...

My basket at Overclockers UK:
Total: £599.98 (includes shipping: £0.00)
​

these should be able to be overclocked to 3200hz with just changing the speed and manual voltage to 1.4v

stop gap for PSU maybe- cheaper then Seasonic unit thats 1300w but larger then bequiet 1000w unit at slightly more cost.

this kolink unit not to be confused with the budget branding name and budget smaller units!

https://www.kitguru.net/components/power-supplies/zardon/kolink-continuum-1200w-psu-review/

My basket at Overclockers UK:
Total: £374.98 (includes shipping: £0.00)


again worth getting a gtx 1060 6gb for your ryzen render unit as well! losing up to 70% extra boost at stage one!

My basket at Overclockers UK:
Total: £299.99 (includes shipping: £0.00)
​
should get £150+ for the rx 480​
Click to expand...
any problems with that ram and the CPU cooler?
Think we will stick with the 1100w be quiet PSU.
 
orbitalwalsh said:
ram should go straight in, XMP enabled and off it goes - some reason team group only list that model for 16GB Sticks




I've quoted Gigabyte for unmatched RMA and support on here - quick flip through and you'll see it .
as for the 7 Pro over Aorus 3 is due to the power draw. the CPU draw is spread over dual 8 PINS instead of a single 8 pin. if you've seen reviews then extreme overclocks pull 600+ watts just to the CPU so splitting that load over 2 plugs is always better etc etc . I know your not going to do massive overclock but still loading all 14 cores to even 4ghz , will still pull a lot of watt so best to spread that load. also the vrm cooling and amount is better/bigger to handle the heat .

this system should cut a lot of time off your current but it seems like it'll still be burning the midnight oil.. rather quote higher then lower - lot of hardware and £££ to **** up
Click to expand...

to be honest im not really sure on how we are going to overclock just yet but best to have the head room.

on the ram we need to enable the XMP you mean?
 
orbitalwalsh said:
yeah- just in the bios you enable XMP- and will make ram run at its advertised speed. buy default all ram runs at 2133hz for DDR 4 .

your ryzen system will also be slow because of ram speed! ryzen is effect a LOT more then intel for ram speed- 3000hz being the sweet perfect spot for ryzen builds

with that Intel i9 it IS WORTH the manual overclock to make sure cores all run at their best - if not it'll run at 3.8ghz when all cores can easily be run at its max single core speed of 4.3ghz - lot of people push 4.4/4.5ghz - but you'll have to see how you get on with heat .

core speed doesn't sound like much but when its 18 threads x 3.8Ghz Vs 18 threads x 4.3Gghz it adds up

worth running a piece at default, then setting all cores to max single core speed 4.3ghz and seeing the task time difference

and remember, Pix3d likes speed as well as core count




PSU unit is solid and unique to the market and very quiet...

https://www.kitguru.net/components/...-straight-power-11-1000w-power-supply-review/

the silent loop 360 will handle the i9 as one of the best AIO but those chips run hot due to Intels poor thermal compound between the die and the heat spreader, its not longer soldered on.

most extreme gamers/overclockers would have that system on custom water loop- but thats a lot of cash....
why i quoted silent case, even if fans need to go to max, should dull down the sound and they are quiet fans on top
Click to expand...

Sound brilliant thanks,

Maybe i should enable XMP on my home pc i have 3000mhz ram on my i5 8400 so maybe thats not running at its full potential.
 
orbitalwalsh said:
in theory yes, but is quite an older case design and would be louder due to fans and open design. If you like corsair then they have updated their D case range

https://www.overclockers.co.uk/cors...k-tempered-glass-cc-9011116-ww-ca-23l-cs.html

can handle 360 AIO up front and glass insulated better then plain panels or acrylic windows .
Main reason why i spec'd the Pure 600 non Window- silence as not going to lie, when your start the process the system will get loud judging from heat load it'll put out and amount of power going through the system.
Most gaming PCs never get a PSU fan to spin above 50%... that will get it to 100% be at least its a bequiet unit with a very expensive £20 fan! haha

pro the most questest case on the market with good airflow due to have 3x 140mm £25 fans on it

https://www.overclockers.co.uk/be-quiet-dark-base-900-full-tower-gaming-case-silver-ca-11a-bq.html

but as you can see, corsair and this one starts to add on the Pounds

rival to bequiet

https://www.overclockers.co.uk/fractal-design-define-r6-midi-tower-case-black-ca-07h-fd.html
Click to expand...
I think i will go with the orginal quoted one.

going to ring and order today including montiors etc today think its worth ringing for free delivery or discount on over a £4500 order?
 
orbitalwalsh said:
would i be cheeky... damn straight i would! hahaha and hope you get a lot of haribo packets ! haha

would be worth quoting the post so hopefully they can see ! again this is going through business ? if so you VAT reg ?
as mention this on the phone and you'll be put through to different team and hopefully get VAT off at the start or afterwards if it is going through business
Click to expand...

haha i will give them a call and let you know how i get on.
 
You must log in or register to reply here.
Back
Top Bottom