It's only fair he got punished for holding him back in the first place then.
With a yellow card? He didn't pull him back, he didn't hold him, he grabbed his arm, then let go, its a foul yes, but its not a yellow card. The ref ****ed up with the first one, then Ribery conned him into the second.