I agree up to a point but a referee sets the tone and level of a game. When the opposition are doing something and getting away with it, the assumption is that the ref is letting it slide. When he turns around and books you for something he lets the opposition do a number of times its not right.
Playing dirty and getting away with it is a massive advantage.