I don't suppose you're using SoundSource, are you?
I've noticed that both with my AirPod Pro 2 and my AirPod Max 2, if I'm using SoundSource and, for instance, have a YouTube video playing and then scroll through Reddit and a video auto-loads (even though the sound is muted on the Reddit video), it causes some sort of interference with SoundSource.
When I quit SoundSource and do the same thing, there are no issues.