There's that, but a lot more women are getting upset at the idea of a guy using their toilets when xe decides xey are female on a Tuesday afternoon for a couple of hours.
I’m sure you’ll quote me some randoms from Twitter, but I suspect (for unknown reasons) more straight men have an issue with this than any women. Much like how most vocal homophobes are men.
Women have bigger concerns than someone having a **** in their toilets, namely the massive sexual harassment they suffer at the hands of cis men.