10G network with 3 hosts

colskinet · 14 Mar 2018 at 14:24

Hi all,

I'm looking at setting up the following:

2 x ESXi 6.5 hosts. Each host has a 2x10Gb NIC.
1 x desktop PC. This has a 10G NIC (single).
1 x Netgear Nightawk router with 1x10G NIC

I have a fibre going from my current server to the Netgear router and this works fine.

I would like to know if the below is the right way of doing it:

The desktop PC won't be on all the while so I may need a switch between that and the servers..

Any thoughts?

Caged · 14 Mar 2018 at 14:36

You want a switch really, otherwise you're software bridging which is not nice.

I don't really think you need 10Gb though.

Steveocee · 14 Mar 2018 at 14:50

I'd certainly look at a switch. Like @Caged says, software bridging isn't nice and you could stand to lose a fair amount of throughput using it.

I disagree though, 10G is exactly where you want to go!

colskinet · 14 Mar 2018 at 15:38

Thanks both, I must admit I’ve never heard the term ‘software bridging’ before?!

I do have a spare switch with 2x10Gb SFP+ ports but not sure that would be sufficient?

10Gb maybe overkill but I’ve got the fibres already in and have everything else apart from maybe a switch so why not!

Caged · 14 Mar 2018 at 15:41

It's because the switches are still a lot of cash per-port.

A two port switch isn't going to help you replace a cable unfortunately.

ChrisD. · 14 Mar 2018 at 16:10

You definitely need a switch, plus if you’re planning on more advanced features by using vCenter then you’ll need at least two VLANs. A 10Gb switch will not be cheap though. Unless you have a need for 10Gb (such as all flash VSAN, though for home use 1Gb works), I’d just get a 1Gb managed switch. I have a 10 port Cisco small business one for sale on here. T

colskinet · 14 Mar 2018 at 19:19

ChrisD. said:
You definitely need a switch, plus if you’re planning on more advanced features by using vCenter then you’ll need at least two VLANs. A 10Gb switch will not be cheap though. Unless you have a need for 10Gb (such as all flash VSAN, though for home use 1Gb works), I’d just get a 1Gb managed switch. I have a 10 port Cisco small business one for sale on here. T

Chris,

Do you have a link to the switch - couldn't find it with a quick search..?

ChrisD. · 14 Mar 2018 at 19:50

https://forums.overclockers.co.uk/t...ateway-appliance-and-cisco-sg300-10.18803843/

Not sure if you have access or not.

bledd · 14 Mar 2018 at 19:51

Netgear xs508m

That's the cheapest way.

Caged · 15 Mar 2018 at 00:54

It's copper though, was under the impression the OP already has SFP+ modules and NICs

colskinet · 15 Mar 2018 at 09:16

Caged said:
It's copper though, was under the impression the OP already has SFP+ modules and NICs

Quite correct, I have the 10G cards and fibre already installed. Nothing stopping me acquiring some 1G SFP's though I guess.

I have found an Ubiquiti SFP+ switch (16XG) so will be having a look at that..

colskinet · 15 Mar 2018 at 09:17

ChrisD. said:
https://forums.overclockers.co.uk/t...ateway-appliance-and-cisco-sg300-10.18803843/

Not sure if you have access or not.

Chris,

Access is denied sadly.

bledd · 15 Mar 2018 at 09:29

Sorry, missed the fibre bit.

16XG is unbeatable in price!

https://www.ubnt.com/unifi-switching/unifi-switch-16-xg/
https://www.ubnt.com/edgemax/edgeswitch-16-xg/

Two options, Unifi = you'll need a controller on another PC/Device to manage the switch, Edgemax = controlled on the device (or by optional controller)

Whichever one you get, there'll be firmware upgrades out of the box for it

colskinet · 15 Mar 2018 at 10:57

Hmm, shall have to make a decision on whether to go and spend more money on the 10G 16-XG or run with an SG300-10SFP for now. There's a fair cost difference as to be expected. In reality the 1G solution would be fine.

Steveocee · 15 Mar 2018 at 11:16

MikroTik CRS317?
16 SFP+ ports and a lot less than a UBNT switch
https://mikrotik.com/product/crs317_1g_16s_rm

ChrisD. · 15 Mar 2018 at 11:24

colskinet said:
Hmm, shall have to make a decision on whether to go and spend more money on the 10G 16-XG or run with an SG300-10SFP for now. There's a fair cost difference as to be expected. In reality the 1G solution would be fine.

What are you planning on doing with VMware? If it's a home lab, I'd just get 1Gb.

colskinet · 15 Mar 2018 at 12:27

ChrisD. said:
What are you planning on doing with VMware? If it's a home lab, I'd just get 1Gb.

Chris,

It hosts my email, will be doing some web site hosting and various other tasks (private cloud etc). It will also be running a Plex server with all content hosted locally. May have upto 5 concurrent users, possibly with demand for 3 to 4 HD streamed movies at any one time.

The more I look at the SG300-10SFP the more I am tempted.. quiet, low power, not overly priced.

Caged · 15 Mar 2018 at 19:46

Nothing you're doing needs 10Gb, I'd save the cash

colskinet · 15 Mar 2018 at 21:42

Caged said:
Nothing you're doing needs 10Gb, I'd save the cash

You're quite right Caged, should have an SG300 with me shortly.

WJA96 · 16 Mar 2018 at 05:41

bledd said:
Sorry, missed the fibre bit.

16XG is unbeatable in price!

https://www.ubnt.com/unifi-switching/unifi-switch-16-xg/
https://www.ubnt.com/edgemax/edgeswitch-16-xg/

Two options, Unifi = you'll need a controller on another PC/Device to manage the switch, Edgemax = controlled on the device (or by optional controller)

Whichever one you get, there'll be firmware upgrades out of the box for it

If anyone is looking for a US-16-XG, make 100% sure it’s the Rev. 11 or Rev. 12 model as the ones before that had hardware issues and UBNT are currently RMAing them all.