There are fringe crazies in nearly every movement, it doesn't really discount years of progress, or make the term derogatory does it?
The problem is that feminism is such an umbrella term now. It means different things to different people. Chances are, you're on the same page as some people who identify as anti-feminist.
If you were to go by one definition of it being a movement for equality, you can rest assured that most people would identify as a feminist.
However, feminism has now largely being hijacked by the third-wavers (thanks to the fringe radicals on university campuses and biased gender studies courses) and is giving feminism a bad reputation. If you dare disagree, you get shamed and shouted down. Facts and proper understanding of statistics don't even come into it.
The true equalitarians within feminism as opposed to the #maletears SJWs would do well to identify themselves as just that: equalitarians.
Feminism, by inception, is about positive discrimination to bring women on par with men. The argument now is that we've reached that parity and dividing the genders further over what often amount to non-issues and a lack of personal responsibility is both toxic and destructive to society at large.
If you believe in true equality, it's for everyone regardless of gender or any supposed notion of 'privilege' and is certainly not for one at the expense of the other. Third-wave feminism is selfish and invalidates the problems and voice of anyone in a conceived position of power or privilege which only serves to undermine itself.
Men have problems too, some directly related to the consequences of the progress of feminism. The problem is, third wave feminism likes to invalidate these concerns as it threatens their victimhood agenda.
No one is suggesting that first and second wave feminism was a bad thing or that they don't want equality. Feminism isn't pejorative, third wave is.