Too far IMO. I wouldn't have dropped the phone on the floor, deliberately damaging someone's property isn't cool, regardless.
I would probably have thanked him sarcastically for pulling out in front of me, thrown the wallet in his car and asked him if he knew where his phone was before riding off.