Literally no one else would GAF.
You have an enormous plot compared to them, and get shared "enjoyment" from the fence.
How is it of no concern though? A typical old house would have 3 fences surrounding their back garden, with 1 house on each side, and be responsible for just one of those fences. This property, since the fence extends all the way past the front and that is shared with other properties, I need to worry about those sections being damaged and ultimately paying towards, and also whether or not this fact makes it a difficult sell further down the road.
I'm thinking about worst case scenarios where a bad storm takes out a chunk of the fences, or if those other people living in those surrounding houses have hyperactive kids who might smack a football too hard or whatever else to damage that section, but my point is I've got a total of 7 or 8 houses worth of fencing to worry about paying towards, whereas most houses have just 3, if that makes sense. In my eyes, surely a potential cost and liability is off-putting?