It makes perfect sense if people actually knew how the rankings were worked out. People forget that England win the vast majority of their games.
The rankings aren't supposed to be arbitrary, they're supposed the reality of how good teams are. No-one is going to suggest England are terrible; they're a decent side. We can beat most countries - not surprising since we're a decently sized, wealthy football-focused nation. Andorra, for example, don't stand much of a chance.
Fifa's rankings however suggest we're the third best side in the World, whereas that is patently absurd. We're not better than Brazil, Italy or Portugal, for example and when directly tested against teams like France and Sweden we scrapped by but didn't show ourselves to be substantially stronger sides as the ratings suggest.
Clearly, FIFA's methods of calculating the rankings aren't fit for purpose.