My neighbour's (not attached but close) kid plays and they popped around and asked if I would mind before letting him play the first time they also stipulated times he could play and told me those times. I thought it was a very courteous approach and was a good way of pre-empting any issue. I'm pretty relaxed about things anyway and like to be annoying myself from time to time so don't tend to point the finger too much.
