I parked my car on the street for a few days a while back a few doors down as we had tradespeople coming. It was a section where there there was no house to speak of on the side I parked, and I parked there specifically because I thought there's no chance of annoying anyone.
After a day or two the owner of the house on the opposite side of the street put a note on my windscreen telling me to move it!
I couldn't believe the cheek. There was bags of room for them to get in and out of their drive, I wasn't blocking anything on not even on their side of the street.
I agree with OP in their situation, especially if there's space for the other party to park in front of their own home, but it's hilarious how weird some people can be about cars being parked legally on a public street.