Why is 10 Gb Ethernet still so expensive?

deuse · 18 Jul 2020 at 16:02

ChrisD. said:
Yes of course.

Thank you.

I getting just under 600MBs a sec. From a SSD to the Nas.
But from the Nas to SSD I only get 80 MBs?

I did try giving the 10GB a static IP in windows
But they wouldn't connect to the Nas
Sorry for asking...

And I tried port trunking on the nas, but windows could not see the nas...
I should have said that it's a straight 10GB connection to the Nas. No switch

Update=I put the jumbo frames to 9000 on both the nas and pc.

Now I get 850 MBs to the nas. And just shy of 400MBs from the Nas.

BongoHunter · 19 Jul 2020 at 11:47

deuse said:
Thank you.

I getting just under 600MBs a sec. From a SSD to the Nas.
But from the Nas to SSD I only get 80 MBs?

I did try giving the 10GB a static IP in windows
But they wouldn't connect to the Nas
Sorry for asking...

And I tried port trunking on the nas, but windows could not see the nas...
I should have said that it's a straight 10GB connection to the Nas. No switch

Update=I put the jumbo frames to 9000 on both the nas and pc.

Now I get 850 MBs to the nas. And just shy of 400MBs from the Nas.

How big a transfer is this? And what disks do you have at both ends?

Edit: and if you get windows resource manager open when doing this do you see traffic on the same NIC regardless of whether your copying to or from the NAS?

deuse · 20 Jul 2020 at 06:52

BongoHunter said:
How big a transfer is this? And what disks do you have at both ends?

Edit: and if you get windows resource manager open when doing this do you see traffic on the same NIC regardless of whether your copying to or from the NAS?

In my Qnap 953X I have 5 X 4TB @7200 rpm Toshiba disks.
My PC has a mix of SSD and normal Hard drives.

The file is a 20GB rar file. I will look at the resource manger later.

I was going to try port trunking again on both the PC and Nas to see if I get better speed.
Will report back.

deuse · 20 Jul 2020 at 07:12

BongoHunter said:
How big a transfer is this? And what disks do you have at both ends?

Edit: and if you get windows resource manager open when doing this do you see traffic on the same NIC regardless of whether your copying to or from the NAS?

I see traffic on just 1 10gb nic when copying files.
So it only uses 1 Nic.

Just copied a 20GB file to a normal HD and I get just 200 MB second.

ChrisD. · 20 Jul 2020 at 09:41

deuse said:
I was going to try port trunking again on both the PC and Nas to see if I get better speed.

You won't, stop. That's not how port trunking works and it's one of the biggest misunderstandings in networking.

You're going to be limited by the speed of the disks.

deuse · 20 Jul 2020 at 09:43

ChrisD. said:
You won't, stop. That's not how port trunking works and it's one of the biggest misunderstandings in networking.

You're going to be limited by the speed of the disks.

Good to know.
Thank you.

Just installing my steam games on the nas.

HEADRAT · 21 Jul 2020 at 11:59

Here is a test I did copy from one m.2 to another m.2 SSD over 10GigE

y4mp3VeQxiiXgauBWrKn1qIf4HiII68XOspELpovvdiWl32HSKwGTTDOLHpMPVGPC-VWPL1kAvVq-Q6-Y352HrhReE1Oa5ipfOct0DbH3dPvPrrl4eziMMGsVAbiISd70mltfPJVdqM83aQUJ_iY4Utwa6sIper8jxwT-SFWWj_it5rHvZikTGD_ecKn2itiAnX6f37chqdiIqpp5vMfrZYVw

deuse · 21 Jul 2020 at 12:28

HEADRAT said:
Here is a test I did copy from one m.2 to another m.2 SSD over 10GigE

Thanks.

I get near that when I transfer to my nas.
Back to my PC is good to an SSD but crap (200MB)to a normal disk.

I just tried SSD cache. Using 2 X 500gb SSDs.
And it slowed right down. Turned it off and I'm back to full speed

ChrisD. · 21 Jul 2020 at 12:48

Yeah Q Tier and SSD cache on the QNAP is crap IME, you're better off having two separate RAID groups.

deuse · 21 Jul 2020 at 15:26

ChrisD. said:
Yeah Q Tier and SSD cache on the QNAP is crap IME, you're better off having two separate RAID groups.

Very true.

I will wait for the sales to get another 2 SSDs.

HEADRAT · 22 Jul 2020 at 13:34

This improved my perf, enable large MTU in SMB, and disable bandwidth throttling

Set-SmbClientConfiguration -EnableBandwidthThrottling 0 -EnableLargeMtu 1

https://docs.microsoft.com/en-us/windows-server/storage/file-server/troubleshoot/slow-file-transfer

Before

After

y4mWCQOY446Bv90WCzxzfSuGC3Qh0tSP48ypehYWMwZv2slU1v0FREVDM8ufsr4Vdh7rkHAO8n2nv0TuilHnvDtgXvaJsiZMakMXjSUJWj7_ZoSXJaQcjdHNMk9qDPwKUIuJ-BMuau4tqE2aW2ivKrWuuA6bvV0MuWpICQ-J6tVm8o8IQDqBOLec6EJCRLci4ToMFxb_22bh9XpysRKM5l95g

Pretty much line rate, not bad for £150 switch!

Also seem to improve transfers to my NAS, less sawtooth now, fewer dips and higher max.

deuse · 22 Jul 2020 at 15:00

HEADRAT said:
This improved my perf, enable large MTU in SMB, and disable bandwidth throttling

Set-SmbClientConfiguration -EnableBandwidthThrottling 0 -EnableLargeMtu 1

https://docs.microsoft.com/en-us/windows-server/storage/file-server/troubleshoot/slow-file-transfer

Before

After

Pretty much line rate, not bad for £150 switch!

Also seem to improve transfers to my NAS, less sawtooth now, fewer dips and higher max.

WOW that is great.

A great find. Reading now...

I tried Set-SmbClientConfiguration -EnableBandwidthThrottling 0 -EnableLargeMtu 1 but get errors..

"t-SmbClientConfiguration : Access is denied." then a shed load of text...I will do some reading on the error as I want that speed

I tried again power shell still the same hmmm..

HEADRAT · 22 Jul 2020 at 15:14

Are you running Powershell as administrator?

deuse · 22 Jul 2020 at 15:19

HEADRAT said:
Are you running Powershell as administrator?

Just tried again pressed A "Yes to all" and it went to PS c:windows\system32... I will restart now

It's a tiny bit faster, but not as fast as yours.
20gb file from nas to PC SSD it starts @ 800MB then slows to 400MB

From PC SSD to nas, it starts @ 450MB then goes to @50MB halfway through.

My 10GB is a direct connection to the nas. So that could be it.

Found out why.
The ARM cpu is the problem

HEADRAT · 22 Jul 2020 at 15:27

Don't have a before picture but it now much better from my NAS to PC

y4mqDiQh1xziD19mZpPND3Ei1egqDyu8u_QG-fZTwVJBq_cRCJKQKC8mYl8UxLvYMFGL5xT1kDVz6ZW2OyXhXwpy_vWCMEyfOcHj6AMPfLKmA4TspRTy955tnTRZcyx8dG50nH_mYLP5IhxQ6ukpqan4lxBT33s5r2I9KKebsJ4g58wznX1waI13Wkn2uZIFCybL3rcsmU6_gmQd8oJTFistQ

it's certainly improved things.

This is so much nicer than arguing about Trump, don't you agree, hopefully you don't think I'm quite so bad now

deuse · 22 Jul 2020 at 15:43

HEADRAT said:
Don't have a before picture but it now much better from my NAS to PC

it's certainly improved things.

This is so much nicer than arguing about Trump, don't you agree, hopefully you don't think I'm quite so bad now

I never thought you or anyone was bad. But everyone likes a good shouting match

So your getting about 800MB to your SSD now?

HEADRAT · 22 Jul 2020 at 16:00

deuse said:
So your getting about 800MB to your SSD now?

This is my SSD to SSD transfer

deuse · 22 Jul 2020 at 16:04

HEADRAT said:
This is my SSD to SSD transfer

By the power of GreySkull !!

HEADRAT · 22 Jul 2020 at 16:26

This is from X399 Taichi (Samsung SSD 970 Evo 1TB M.2) to X99 GA-X99-Designare (Samsung SSD 970 Evo 1TB M.2)

deuse · 22 Jul 2020 at 16:32

HEADRAT said:
This is from X399 Taichi (Samsung SSD 970 Evo 1TB M.2) to X99 GA-X99-Designare (Samsung SSD 970 Evo 1TB M.2)

Top hardware there dude.
You must be pleased with the speed.

I was hoping for a 3TB SSD for£200 by now