Latency Spikes - Opnsense

Soldato
Joined
8 Nov 2003
Posts
7,409
Location
UK
Hi,

I've noticed that on my network I have latency spikes and after some research it would appear that I have them because I have a FreeBSD based OS, I use a Intel NIC with an IGB driver, and a PPPOE connection. I've added some tunables which in testing appeared to have cured the spikes - I was seeing like >500ms (some as high as 2000ms if memory serves me well).

When there isn't much activity on my network, i.e. I am the only one home and not streaming or anything, I can ping 8.8.8.8 and get on average say 12ms over 10 requests (I've tested up to 250 at one second intervals) and it's quite consistent now. However, if I ping somewhere and then start streaming, the pings appear consistent with no spikes but are higher at 40ms on average over 25 requests. An obvious improvement, however is this normal, or acceptable on a BT based line, 15/62Mbits for it to jump by around 107%? Would you expect response closer to normal but a little higher maybe? Probably a stupid question.

Additional info: I do have VLANs and have set the priority on each, most at default but my Work vlan has the highest over all the others. The device that I started the stream on has a lower priority than the computer doing the pinging on the Work vlan.

I have bought another NIC but a Broadcom based one as it's cheap and it's probably good to have a spare, I will test it and remove the tunables when I receive it.

Thanks
 
I just setup an Opnsense router a few days ago and thought I'd try this. So with normal background network activity I was getting 9/10ms pings to 8.8.8.8 and if I then watched a 4K stream on YouTube I got the same. Mind you I have 1Gbps symmetric fibre and I'm running on a J4125 based mini pc with 2.5Gbps NICs, PC is connected via 1Gbps and I don't have VLANs enabled.
 
I spent hours trying to configure an old Mikrotik Hex with nearly the same setup. I need to setup rules so various vlans can't communicate with each other, change DNS and set up vlan priority. That being said I get 10ms with no activity, and 13ms with multiple streams.

Waiting on this other NIC, hopefully it fixes the issue because I like Opnsense.
 
Have been running PPPoE FTTP with Opnsense for years, no noticeable ping spikes.

Running as a VM on UnRAID with a 8600T (two cores assigned) and a 13600 (two E-cores assigned).
 
Presume you have an Intel NIC running the igb driver...that's interesting.

Mine has:
Intel i5-4590
16GB RAM
SSD
Dell E1G44ET2 NIC

Its in a Lenovo Thinkcentre M93P
 
So, I don't know a lot about networks, and I am a bit confused to be honest. On opnsense I had the vlans set with varying PCP codes (dot1P). I can't find this in Mikrotik's RouterOS, and it seems that's because it is a layer 2 thing. Why would it be in Opnsense and could that be affecting the speed negatively even for the higher priority vlans?
 
Back
Top Bottom