"Sounds like classic USB or radio interference problems, especially if the HMD is pretty much OK but the controllers are blowing up often.
There is lots of stuff you can try: Disable or down-rate the camera, try a different USB port (on a different root hub/HCI). Turn off WiFi if the PC has it.
It might be reflections, especially if your bases aren't pointed down a lot, or are pointed at that glass door at angles that would scatter back into the room. If you can see the base station status light reflected in something sensors can probably see beam reflections at the same location as your eyeball. Lighthouse is pretty resistant to reflections in good conditions but when all it has left to see are reflections it can get confused. Stories of daylight and normal room lighting breaking it are nonsense. There are unconfirmed reports of some kinds of fancy LED lighting causing problems at very close range, might be RFI rather than optical interference.
You can have more than one problem simultaneously. I can't stress this strongly enough, as this can really confuse the heck out of you. If the USB is blowing up only when the chaperone comes up (because of camera activation) it can cause very strange behaviour. You might have minor reflection issues in one region of the tracked volume that make the HMD wig-out only there, but bad RFI problems from a WiFi gateway coupling into the tether or your PC's power connections that bugger up the controllers all over the place. The system is simply too complex to document every possible interaction, the real world is full of EMC and software interactions that are basically unpredictable.
The main approach is to apply science to debugging. The full hardware and software stack is a very complicated system, debugging takes patience and attention to detail. Change one variable at a time, look at the logs and system report, track from one base at a time (in mode A) with the other turned off, etc. Think about how the system actually works and test your mental model with experiments, use this to reason about how it might be broken. Look for correlations, but try not to fall prey to cargo cult beliefs without good repeatable evidence to support your conclusions."
