10gbit home network speed issues

[jonneymendoza]

Hi all, i recently upgraded my home network to 10Gbit but i dont get this speed
TD:LR
Two devices have 10gbit network adapters and between the two i get max 2gbit speed.
My windows based laptop with wifi 5 gets around 30/60mpbs
Below is my Network devices and how it is connected
my isp > Netgea R7800 router > Netgear 10-port/10G switch(GS110EMX) > (windows deskto pc/ ubuntu linux desktop server)

Specs of the machines:

Desktop windows PC.
3x SanDisk ultra 960GB sata 3 hdd
ipolex 10Gb PCI Express Network Card for Intel X550-T1

Ubuntu server 18.0.4
Crucial m500 240gb ssd hdd(OS installed on it)
2x WD Red 3.5 6TB hdd's
2x WD Red 3.5 3tb hdd's
ipolex 10Gb PCI Express Network Card for Intel X550-T1
Laptop Thinkpad x1 extreme:

2tb Samsung 970 evo
Intel(R) Wireless-AC 9560 160MHz

The desktop pc is connected to the negtear 10gb switch using a cat 8 cable thats 2m long and the ubuntu server desktop is also connected to the same switch using a CAT8 cable.

A single Cat 5e cable is used to connect the switch to the netgear router that handles dhcp for all my network attached devices.

When i transfer some files located on one of my Sandisk SSD hdd and transfer it into my ubuntu server i get only between 1-2gbit speeds only.

Is this due to hdd bottleneck on the windows pc or in the ubuntu server?

Would i only get the full 10gbit speed if i had a m.2 nvme hdd attached to both the windows pc and ubuntu server?

Does the data between this transfer goes through my negear router and then back onto the switch that may cause the delay?

Wifi speed is also slow even when the laptop is right next to the router and has a wifi 5 card that should be capable of 1gbit speeds

 

[jonneymendoza]

Iperf results:

Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.1.18, port 63892
[ 5] local 192.168.1.222 port 5201 connected to 192.168.1.18 port 63893
[ ID] Interval Transfer Bandwidth
[ 5] 0.00-1.00 sec 179 MBytes 1.50 Gbits/sec
[ 5] 1.00-2.00 sec 176 MBytes 1.47 Gbits/sec
[ 5] 2.00-3.00 sec 210 MBytes 1.76 Gbits/sec
[ 5] 3.00-4.00 sec 189 MBytes 1.59 Gbits/sec
[ 5] 4.00-5.00 sec 208 MBytes 1.74 Gbits/sec
[ 5] 5.00-6.00 sec 226 MBytes 1.90 Gbits/sec
[ 5] 6.00-7.00 sec 225 MBytes 1.89 Gbits/sec
[ 5] 7.00-8.00 sec 197 MBytes 1.65 Gbits/sec
[ 5] 8.00-9.00 sec 223 MBytes 1.87 Gbits/sec
[ 5] 9.00-10.00 sec 255 MBytes 2.14 Gbits/sec
[ 5] 10.00-10.04 sec 6.14 MBytes 1.37 Gbits/sec

 

[jonneymendoza]

Cat8 patch lead? try a half good like an excel cat6 one, many so called cat7 and cat 8 cables are rubbish.

I will try one Cat6e lead i have lying around.

Will try and source more cat 6e cables but from the usual place i grab my stuff, they did not have many 2m ones

 

[jonneymendoza]

Are you limited by the PCIe ports you're using by chance? I know I get a warning when booting my server that my 10 GbE card is limited to 8 Gb/s due to the PCIe slot it's in, and then it estimates a maximum transfer speed of around 7 Gb/s.

I will double check when i boot it up again as i dont remember seeing a warning

 

[jonneymendoza]

Try changing MTU both ends to 9000 (assuming the switch supports it). I’ve had this with Ubuntu before.

It does not look like i can change the mtu from the switch

 

[jonneymendoza]

yea sorry typos i meant cat 6a. i will try get some cat 6a cables and see how i get on

 

[jonneymendoza]

Forgot to mention: I doubt Windows will show a warning, I was talking about a Linux box where the warning was printed in the syslog. You can check your motherboard manual to find out the link speeds of each PCIe slot and how they're affected when other devices are plugged in.

Ok cool i will check my motherboard manual to see what the speeds are

 

[jonneymendoza]

Try different network cables. Any decent quality (i.e. not something random from Amazon/eBay) Cat6 or Cat6a cables will be more than adequate.

I tried different cables and got the same sort of speeds and i also checked the pic e slots i have and i have it attached to a pcie 3.0 12x lane slot

 

[jonneymendoza]

Done a loopback test on all the new adapters?

I had huge issues with my 10gig network, turned out to be a faulty Intel adapter.

what hdd's did you use in order to see 10gbit speeds? i imagine even a ssd sata 3 drive wont yeld 10gbit as sata 3's max speed is 6gbit..

 

[jonneymendoza]

What is Cat 8 cable? You want Cat 6 cable that is NOT (edit) copper and copper-clad aluminium (CCA)

You should also try connecting the two 10 Gb NICs directly - you'll need to manually assign IP addresses & stuff - and measuring the speed you get that way.

I have some new cat 6a cables and i only get around 2gbit speeds still when performing that Loopback test between my windows desktop as a client and my ubuntu server .

i also checked the PCI E port slot on my ubunut server and it should not bottleneck the NIC.

i will double check the PCI E slot on my main desktop but should be ok as that motherboard is a Asus x99 Board

 

[jonneymendoza]

Umm I may try install Ubuntu on my desktop. Duel boot into it and retest the speeds

Not sure, if I do a test to the loopback interface on my desktop I get 15 Gbps.

 

[jonneymendoza]

For testing, you should be able to get away with a live version running from a DVD or USB stick.

Wouldnt the USB interface/controller affect the speed though?

 

[jonneymendoza]

Not unless your testing included copying data to/from the USB drive.

So just running iperf via usb bootable live cd would do the job?

 

[jonneymendoza]

A live os often totally loads into ram.

o i did not know that.

very interesting. i will give this a go later

 

[jonneymendoza]

Have not tried using Linux yet but hopefully will soon and see the speed I get on iperf and @RSR what hdd are you using at either ends of that connection?

 

[jonneymendoza]

All I've done is put in an AMD CPU and motherboard, same Windows build and I now get 8.5 Gbit/s from my Windows 10 desktop to my QNAP.

nice! so its a windows problem?