10gbit home network speed issues

jonneymendoza · 19 Nov 2019 at 16:45

Hi all, i recently upgraded my home network to 10Gbit but i dont get this speed
TD:LR
Two devices have 10gbit network adapters and between the two i get max 2gbit speed.
My windows based laptop with wifi 5 gets around 30/60mpbs
Below is my Network devices and how it is connected
my isp > Netgea R7800 router > Netgear 10-port/10G switch(GS110EMX) > (windows deskto pc/ ubuntu linux desktop server)

Specs of the machines:

Desktop windows PC.
3x SanDisk ultra 960GB sata 3 hdd
ipolex 10Gb PCI Express Network Card for Intel X550-T1

Ubuntu server 18.0.4
Crucial m500 240gb ssd hdd(OS installed on it)
2x WD Red 3.5 6TB hdd's
2x WD Red 3.5 3tb hdd's
ipolex 10Gb PCI Express Network Card for Intel X550-T1
Laptop Thinkpad x1 extreme:

2tb Samsung 970 evo
Intel(R) Wireless-AC 9560 160MHz

The desktop pc is connected to the negtear 10gb switch using a cat 8 cable thats 2m long and the ubuntu server desktop is also connected to the same switch using a CAT8 cable.

A single Cat 5e cable is used to connect the switch to the netgear router that handles dhcp for all my network attached devices.

When i transfer some files located on one of my Sandisk SSD hdd and transfer it into my ubuntu server i get only between 1-2gbit speeds only.

Is this due to hdd bottleneck on the windows pc or in the ubuntu server?

Would i only get the full 10gbit speed if i had a m.2 nvme hdd attached to both the windows pc and ubuntu server?

Does the data between this transfer goes through my negear router and then back onto the switch that may cause the delay?

Wifi speed is also slow even when the laptop is right next to the router and has a wifi 5 card that should be capable of 1gbit speeds

bremen1874 · 19 Nov 2019 at 17:01

The data will take the shortest path and won't go via the router. If it was it'd be pegged at 1Gbps.

If you're transferring data to/from mechanicals drives you're going to limited by their transfer rates. What you're seeing makes sense for WDC Reds.

Why did you feel the need to buy Cat8 cables? It's pointless.

moogle · 19 Nov 2019 at 17:04

Download a tool call NTTcp or iperf and try an in memory test to rule out the disks. You should see 9.8Gb/s or so if your CPUs are up to the challenge. That can affect the speed too if the CPU is bottlenecking.

ChrisD. · 19 Nov 2019 at 17:13

Use iperf and test, it's likely the drive speed causing slower speeds.

jonneymendoza · 19 Nov 2019 at 17:31

Iperf results:

Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.1.18, port 63892
[ 5] local 192.168.1.222 port 5201 connected to 192.168.1.18 port 63893
[ ID] Interval Transfer Bandwidth
[ 5] 0.00-1.00 sec 179 MBytes 1.50 Gbits/sec
[ 5] 1.00-2.00 sec 176 MBytes 1.47 Gbits/sec
[ 5] 2.00-3.00 sec 210 MBytes 1.76 Gbits/sec
[ 5] 3.00-4.00 sec 189 MBytes 1.59 Gbits/sec
[ 5] 4.00-5.00 sec 208 MBytes 1.74 Gbits/sec
[ 5] 5.00-6.00 sec 226 MBytes 1.90 Gbits/sec
[ 5] 6.00-7.00 sec 225 MBytes 1.89 Gbits/sec
[ 5] 7.00-8.00 sec 197 MBytes 1.65 Gbits/sec
[ 5] 8.00-9.00 sec 223 MBytes 1.87 Gbits/sec
[ 5] 9.00-10.00 sec 255 MBytes 2.14 Gbits/sec
[ 5] 10.00-10.04 sec 6.14 MBytes 1.37 Gbits/sec

bremen1874 · 19 Nov 2019 at 17:35

Try different network cables. Any decent quality (i.e. not something random from Amazon/eBay) Cat6 or Cat6a cables will be more than adequate.

Silicon Si · 19 Nov 2019 at 17:35

Cat8 patch lead? try a half good like an excel cat6 one, many so called cat7 and cat 8 cables are rubbish.

DragonQ · 19 Nov 2019 at 17:37

Are you limited by the PCIe ports you're using by chance? I know I get a warning when booting my server that my 10 GbE card is limited to 8 Gb/s due to the PCIe slot it's in, and then it estimates a maximum transfer speed of around 7 Gb/s.

jonneymendoza · 19 Nov 2019 at 17:39

Silicon Si said:
Cat8 patch lead? try a half good like an excel cat6 one, many so called cat7 and cat 8 cables are rubbish.

I will try one Cat6e lead i have lying around.

Will try and source more cat 6e cables but from the usual place i grab my stuff, they did not have many 2m ones

jonneymendoza · 19 Nov 2019 at 17:39

DragonQ said:
Are you limited by the PCIe ports you're using by chance? I know I get a warning when booting my server that my 10 GbE card is limited to 8 Gb/s due to the PCIe slot it's in, and then it estimates a maximum transfer speed of around 7 Gb/s.

I will double check when i boot it up again as i dont remember seeing a warning

ChrisD. · 19 Nov 2019 at 17:41

Try changing MTU both ends to 9000 (assuming the switch supports it). I’ve had this with Ubuntu before.

jonneymendoza · 19 Nov 2019 at 17:46

ChrisD. said:
Try changing MTU both ends to 9000 (assuming the switch supports it). I’ve had this with Ubuntu before.

It does not look like i can change the mtu from the switch

bremen1874 · 19 Nov 2019 at 18:13

You change it on the devices, the switch just needs to support it (AFAIK).

bremen1874 · 19 Nov 2019 at 18:15

jonneymendoza said:
I will try one Cat6e lead i have lying around.

Will try and source more cat 6e cables but from the usual place i grab my stuff, they did not have many 2m ones

Hopefully a typo, but there is some junk out there labelled as Cat6e.

You want Cat6 or Cat6a (or at 2m decent Cat5e would probably be okay as well).

jonneymendoza · 19 Nov 2019 at 18:20

yea sorry typos i meant cat 6a. i will try get some cat 6a cables and see how i get on

DragonQ · 20 Nov 2019 at 10:17

jonneymendoza said:
I will double check when i boot it up again as i dont remember seeing a warning

Forgot to mention: I doubt Windows will show a warning, I was talking about a Linux box where the warning was printed in the syslog. You can check your motherboard manual to find out the link speeds of each PCIe slot and how they're affected when other devices are plugged in.

jonneymendoza · 20 Nov 2019 at 17:45

DragonQ said:
Forgot to mention: I doubt Windows will show a warning, I was talking about a Linux box where the warning was printed in the syslog. You can check your motherboard manual to find out the link speeds of each PCIe slot and how they're affected when other devices are plugged in.

Ok cool i will check my motherboard manual to see what the speeds are

jonneymendoza · 23 Nov 2019 at 11:58

bremen1874 said:
Try different network cables. Any decent quality (i.e. not something random from Amazon/eBay) Cat6 or Cat6a cables will be more than adequate.

I tried different cables and got the same sort of speeds and i also checked the pic e slots i have and i have it attached to a pcie 3.0 12x lane slot

Firestar_3x · 23 Nov 2019 at 12:00

Done a loopback test on all the new adapters?

I had huge issues with my 10gig network, turned out to be a faulty Intel adapter.

jonneymendoza · 23 Nov 2019 at 12:14

Firestar_3x said:
Done a loopback test on all the new adapters?

I had huge issues with my 10gig network, turned out to be a faulty Intel adapter.

what hdd's did you use in order to see 10gbit speeds? i imagine even a ssd sata 3 drive wont yeld 10gbit as sata 3's max speed is 6gbit..

Firestar_3x · 23 Nov 2019 at 12:29

Nvme to Nvme, but i used ramdisks for testing.

Usual storage is tiered with NVME cache and raided drives sat behind for mass storage.