Very similar experience for me and the wife when we moved to the area we live in at the moment.
Long story short: Took the harassment about three years to eventually calm down. Police naff all help, I spiralled back into depression and almost drank myself to death. It basically just came down to taking it until it stopped, which was very, very stressful.
Bounced back, though. Like Alan Partridge, mother******s.
Still, despite it being relatively OK now, the experience has ruined by opinion of the place. I don't like to go outside, if even to the shop just down the road, as the absolute disgust and hatred that I feel for every single person in a half mile radius -- whether warranted or not -- is harrowing.
The day we manage to get the money together to move away is the day my grin splits my head in half.