They aren't comparable. Free speech folk defend your right to say whatever, even if they disagree. The other side try to prevent you from saying stuff in the first place.
I think most people agree with you. The problem is - if people make false accusations and aren't challenged then they win by default. So the media would have you believe all white men are a problem, if you are a white man you can't be expected to bend over and let it happen.
Seems that many do expect us to just bend over and let it happen though.
Nope.