It's probably capacitor whine caused by a vibration resonance between your PSU and graphics card.
Is it only happening with this mouse?
I used to have it when scrolling but never on mouse move.
Is your mouse one that can set it's polling rate? Maybe alter that?