If someone had come up to me and said "You're annoying" my first response would be ".......and?".
If someone had come up to me and asked "Can you please stop doing that" then I would probably stop doing it.
Pretty much sums up the way I would react. If asked politely then I would most likely listen.
If someone asked me in a rude manner like "You're annoying me" then I'm more likely to not give a flying **** what you think or say.
Treat people how you expect to be treated back.