If tomorrow you were charged with making racist remarks and the only evidence against you was the accusers word, would you accept the charge and move on?
There must have been more to it. Otherwise everyone will start doing it.
Or you know, he may have actually said it, and Evra was upset so ruthlessly pursued this and they could see that? It's not something to be taken lightly.