This is what I see when I've taken ownership:
Trials and tribulations of a new Admin.
- Thread starter nutcase
- Start date
next issue I'm seeing, I think I know the answers to - but would like a sanity check before I go cap in hand to the powers that be...
VM host - 3Gb teamed NIC
Veeam repository - 2Gb teamed NIC
I'm seeing massive dropped transmit packets during the backup window. First thing I'll try is knocking the host back to a 2Gb NIC so it's not trying to squeeze 3Gb down a 2Gb pipe...
But I'm seeing dropped transmit packets the other direction as well - over 10 million when I ran a restore test.
One think I've learned is that Netgear don't advertise the Mpps rate. We have a couple of HP 1920s that advertise a 14.8 Mpps so no sure why Netgear don't advertise? The netgear has a 2MB buffer but I'm not sure that's overly relevant because if it can't pass the packets quickly enough, it will just fill up and start dropping - it's the Mpps rate that is more important?
I'm thinking we need a better server cupboard switch to cope with the backup traffic?
VM host - 3Gb teamed NIC
Veeam repository - 2Gb teamed NIC
I'm seeing massive dropped transmit packets during the backup window. First thing I'll try is knocking the host back to a 2Gb NIC so it's not trying to squeeze 3Gb down a 2Gb pipe...
But I'm seeing dropped transmit packets the other direction as well - over 10 million when I ran a restore test.
One think I've learned is that Netgear don't advertise the Mpps rate. We have a couple of HP 1920s that advertise a 14.8 Mpps so no sure why Netgear don't advertise? The netgear has a 2MB buffer but I'm not sure that's overly relevant because if it can't pass the packets quickly enough, it will just fill up and start dropping - it's the Mpps rate that is more important?
I'm thinking we need a better server cupboard switch to cope with the backup traffic?
Both devices are (at present) directly connected to the same switch by patch leads. The repository is connected with new leads (no guarantee of course) and the host is re-using ones from a previous server but still only a couple of years old. Think I've seen a basic lead tester somewhere I could try.
I'll also set the ports to fixed gigabit instead of auto though. edit: except it would seem the only settings are auto, 10 and 100 so can't fix them at gigabit.
Thanks
I'll also set the ports to fixed gigabit instead of auto though. edit: except it would seem the only settings are auto, 10 and 100 so can't fix them at gigabit.
Thanks
Last edited:
I've upped the monitoring on the switch and servers. I've got to nip into the office tomorrow so will try different patch leads.
Thanks guys looks like I need to do some more reading on teaming as the guides I found didn't mention things like if point to point you still only get the one connection's bandwidth...
Changing the cables had no effect.
Changing the cables had no effect.
OSs are Server 2012 R2 and Hyper-V Server 2012 R2. Both those are set to Dynamic LACP and the switch is set to LACP for the LAG.
Haven't had any time to do any troubleshooting yet as other stuff has been higher priority, and whilst it's dropping packets, it's not actually breaking anything.
Having said that, just had to head in as I couldn't get on. The main switch decided to flunk out. And as everything runs through it I didn't get any notifications. So there's another reminder that 1) there's no out of band management - everything is on the same network and subnet etc. and 2) there's no redundancy on the main switch.
Fortunately it just needed a restart.
Haven't had any time to do any troubleshooting yet as other stuff has been higher priority, and whilst it's dropping packets, it's not actually breaking anything.
Having said that, just had to head in as I couldn't get on. The main switch decided to flunk out. And as everything runs through it I didn't get any notifications. So there's another reminder that 1) there's no out of band management - everything is on the same network and subnet etc. and 2) there's no redundancy on the main switch.
Fortunately it just needed a restart.
As I understand it MS strongly reccommend not to disable IPv6?
I think I've narrowed it down to the hyper-v host with inbound packets. Checking the firmware it showed up to date, but checking the part number for the NIC itself showed an update so I'm just waiting for a free moment to install that. If that doesn't work I'll try disabling features.
Thanks
I think I've narrowed it down to the hyper-v host with inbound packets. Checking the firmware it showed up to date, but checking the part number for the NIC itself showed an update so I'm just waiting for a free moment to install that. If that doesn't work I'll try disabling features.
Thanks
The particular NICs are Broadcom but don't have VM traffic on them, they're reserved for backup traffic.
During the backup routine. Veeam copies from the Hyper-v server to the repository and the veeam repository to the tape library (which is connected to the hyper-v server).
Ah, apologies. On the switch. I've got a free solarwinds trial going:
Blue receive, green transmit.
Lag switch to hyper-v host
http://imgur.com/ZDSTYIY
http://imgur.com/fsGPMzi
Lag switch to veeam repo:
http://imgur.com/0KiM4qD
http://imgur.com/AcsQ7k6
So packets from the switch to the hosts are being discarded - so not the switch? All the suggested changes have been made to the veeam host but still not had a window to change the hyper-v host.
Blue receive, green transmit.
Lag switch to hyper-v host
http://imgur.com/ZDSTYIY
http://imgur.com/fsGPMzi
Lag switch to veeam repo:
http://imgur.com/0KiM4qD
http://imgur.com/AcsQ7k6
So packets from the switch to the hosts are being discarded - so not the switch? All the suggested changes have been made to the veeam host but still not had a window to change the hyper-v host.
Last edited:
Yeah it has always been doing that (also mentioned above somewhere). I've taken it off of the veeam repo, will see what that does during tomorrows run.
Switch is one of netgear's finest - GS748Tv5
Switch is one of netgear's finest - GS748Tv5
No apparent difference - still transmit packet loss from switch to veeam.
On one end (veeam to switch), have now removed it from the other end.
A screenshot I have before I cleared the lags off, shows transmit packets discarded 14736585
Now that google have killed off picasa, anyone know of an easy upload site?
Thanks I'll look at imgur.
Jumbo frames aren't enabled (one day...)
I now have no dropped packets in the link between the switch and the veeam repo but still having the same issue between the hyper-v server and the switch.
Both are Broadcom (331i and 332i are HPE names)
Jumbo frames aren't enabled (one day...)
I now have no dropped packets in the link between the switch and the veeam repo but still having the same issue between the hyper-v server and the switch.
Both are Broadcom (331i and 332i are HPE names)
Not sure why it says lacp enabled.
ifIndex 19
Port Type Normal
Port Channel ID Disable
Port Role Designated
STP Mode Enable
STP State Forwarding
Admin Mode Enable
Flow Control Mode Disable
LACP Mode Enable
Physical Mode Auto
Physical Status 1000 Mbps
Link Status Link Up
Link Trap Enable
Packets RX and TX 64 Octets 437178841
Packets RX and TX 65-127 Octets 47022406
Packets RX and TX 128-255 Octets 9528284
Packets RX and TX 256-511 Octets 4549171
Packets RX and TX 512-1023 Octets 3904132
Packets RX and TX 1024-1518 Octets 1732503071
Packets RX and TX 1519-2047 Octets 0
Packets RX and TX 2048-4095 Octets 0
Packets RX and TX 4096-9216 Octets 0
Octets Received 1189081540207
Packets Received 64 Octets 422535301
Packets Received 65-127 Octets 45472749
Packets Received 128-255 Octets 6138362
Packets Received 256-511 Octets 3393775
Packets Received 512-1023 Octets 2818597
Packets Received 1024-1518 Octets 760823578
Packets Received > 1518 Octets 0
Total Packets Received Without Errors 1241182362
Unicast Packets Received 1241141636
Multicast Packets Received 26249
Broadcast Packets Received 14477
Receive Packets Discarded 0
Total Packets Received with MAC Errors 0
Jabbers Received 0
Fragments Received 0
Undersize Received 0
Alignment Errors 0
Rx FCS Errors 0
Overruns 0
Total Received Packets Not Forwarded 0
802.3x Pause Frames Received 0
Unacceptable Frame Type 0
Total Packets Transmitted (Octets) 1476878822537
Packets Transmitted 64 Octets 14643540
Packets Transmitted 65-127 Octets 1549657
Packets Transmitted 128-255 Octets 3389922
Packets Transmitted 256-511 Octets 1155396
Packets Transmitted 512-1023 Octets 1085535
Packets Transmitted 1024-1518 Octets 971679493
Packets Transmitted > 1518 Octets 0
Maximum Frame Size 1518
Total Packets Transmitted Successfully 993503543
Unicast Packets Transmitted 989396318
Multicast Packets Transmitted 1400441
Broadcast Packets Transmitted 2706784
Transmit Packets Discarded 18832
Total Transmit Errors 0
Total Transmit Packets Discarded 0
Single Collision Frames 0
Multiple Collision Frames 0
Excessive Collision Frames 0
Dropped Transmit Frames 18832
STP BPDUs Received 0
STP BPDUs Transmitted 0
RSTP BPDUs Received 0
RSTP BPDUs Transmitted 44388
MSTP BPDUs Received 0
MSTP BPDUs Transmitted 0
802.3x Pause Frames Transmitted 0
EAPOL Frames Received 0
EAPOL Frames Transmitted 0
Time Since Counters Last Cleared 8 day 0 hr 27 min 52 sec
ifIndex 19
Port Type Normal
Port Channel ID Disable
Port Role Designated
STP Mode Enable
STP State Forwarding
Admin Mode Enable
Flow Control Mode Disable
LACP Mode Enable
Physical Mode Auto
Physical Status 1000 Mbps
Link Status Link Up
Link Trap Enable
Packets RX and TX 64 Octets 437178841
Packets RX and TX 65-127 Octets 47022406
Packets RX and TX 128-255 Octets 9528284
Packets RX and TX 256-511 Octets 4549171
Packets RX and TX 512-1023 Octets 3904132
Packets RX and TX 1024-1518 Octets 1732503071
Packets RX and TX 1519-2047 Octets 0
Packets RX and TX 2048-4095 Octets 0
Packets RX and TX 4096-9216 Octets 0
Octets Received 1189081540207
Packets Received 64 Octets 422535301
Packets Received 65-127 Octets 45472749
Packets Received 128-255 Octets 6138362
Packets Received 256-511 Octets 3393775
Packets Received 512-1023 Octets 2818597
Packets Received 1024-1518 Octets 760823578
Packets Received > 1518 Octets 0
Total Packets Received Without Errors 1241182362
Unicast Packets Received 1241141636
Multicast Packets Received 26249
Broadcast Packets Received 14477
Receive Packets Discarded 0
Total Packets Received with MAC Errors 0
Jabbers Received 0
Fragments Received 0
Undersize Received 0
Alignment Errors 0
Rx FCS Errors 0
Overruns 0
Total Received Packets Not Forwarded 0
802.3x Pause Frames Received 0
Unacceptable Frame Type 0
Total Packets Transmitted (Octets) 1476878822537
Packets Transmitted 64 Octets 14643540
Packets Transmitted 65-127 Octets 1549657
Packets Transmitted 128-255 Octets 3389922
Packets Transmitted 256-511 Octets 1155396
Packets Transmitted 512-1023 Octets 1085535
Packets Transmitted 1024-1518 Octets 971679493
Packets Transmitted > 1518 Octets 0
Maximum Frame Size 1518
Total Packets Transmitted Successfully 993503543
Unicast Packets Transmitted 989396318
Multicast Packets Transmitted 1400441
Broadcast Packets Transmitted 2706784
Transmit Packets Discarded 18832
Total Transmit Errors 0
Total Transmit Packets Discarded 0
Single Collision Frames 0
Multiple Collision Frames 0
Excessive Collision Frames 0
Dropped Transmit Frames 18832
STP BPDUs Received 0
STP BPDUs Transmitted 0
RSTP BPDUs Received 0
RSTP BPDUs Transmitted 44388
MSTP BPDUs Received 0
MSTP BPDUs Transmitted 0
802.3x Pause Frames Transmitted 0
EAPOL Frames Received 0
EAPOL Frames Transmitted 0
Time Since Counters Last Cleared 8 day 0 hr 27 min 52 sec
Last edited:
Rotor, would you mind editing your post that quotes the original picture links Thanks
Thanks
One more item to add to the pile (and a very big pile it is) is our P-WAN renewal is coming up. Another company that supplies our IP Phones has said they can reduce our costs significantly (~30%) with no install costs. We currently have 3 sites with fibre, and 4 with EFM.
Turns out they're offering FTTC for all but a couple of sites. When the current setup was being planned, FTTC wasn't considered because because there was no SLA, no guarantees on bandwidth contention or priority.
The telephone supplier are saying they can offer 22hour fix (with backup ADSL as we have currently), and QoS for our traffic as well as traffic type QoS. Our current supplier still only offers FTTC as one step up on a domestic product. Currently we have 4 or 9 hour fix for our primary circuits.
Two sites have the cabinet within spitting distance so we are offered the full 80/20 rate. Which is WAY over our needs (head office has 20mbit and rarely hits it)
Has anyone looked at FTTC as an alternative to traditional leased lines? Are they a viable alternative now? I'm very sceptical as what we have now works very well indeed but that kind of saving is not to be sniffed at. The supplier before the one we have now we had awful latencies etc. and I *really* don't want to go back to those days!
Turns out they're offering FTTC for all but a couple of sites. When the current setup was being planned, FTTC wasn't considered because because there was no SLA, no guarantees on bandwidth contention or priority.
The telephone supplier are saying they can offer 22hour fix (with backup ADSL as we have currently), and QoS for our traffic as well as traffic type QoS. Our current supplier still only offers FTTC as one step up on a domestic product. Currently we have 4 or 9 hour fix for our primary circuits.
Two sites have the cabinet within spitting distance so we are offered the full 80/20 rate. Which is WAY over our needs (head office has 20mbit and rarely hits it)
Has anyone looked at FTTC as an alternative to traditional leased lines? Are they a viable alternative now? I'm very sceptical as what we have now works very well indeed but that kind of saving is not to be sniffed at. The supplier before the one we have now we had awful latencies etc. and I *really* don't want to go back to those days!
I gather it's an interchangible term yes
Apparently the FTTC they're offering isn't GEA. All will be revealed soon. Apparently.
Thanks Guys
I'm trying to get cost comparisons of the 2920 with modules vs. a 5130 24G 4SFP+ EI - more of a core switch for small business than the Aruba which is more aimed towards an access switch with additional WiFi support which we only have limited wifi.
Meanwhile I'm still looking through how everything is set up. Found that 99% of the user folders were owned by administrator with individual permissions to allow the required access. So that's all been sorted with CREATOR OWNER etc.
Same with the email archive folders (still need to sort those out, about 10% of my days are spent running ScanPst...
Meanwhile I'm still looking through how everything is set up. Found that 99% of the user folders were owned by administrator with individual permissions to allow the required access. So that's all been sorted with CREATOR OWNER etc.
Same with the email archive folders (still need to sort those out, about 10% of my days are spent running ScanPst...