Sounds like you didn't handbrake it. It rolled away out of your sight, across the road, mounted the pavement and came to a rest.
Those guys were probably running at you to make sure you didn't leave the scene in case it had struck other vehicles, LOL.