You just need to stand your ground and tell him that the space isn't his to use exclusively.
Then get CCTV on the front of your house.
if its on a private road then yes, else it is free to be used by anyone and everyone, however they wish. as for the cctv i agree have it up regardless.