What's wrong with saying brown? I've no problem with that, don't know anyone who does.
I don't know a single 'brown' Asian who is either. Infact they all use it to describe themselves.
I think it's another case of some white person with too much time on their hands looking to be offended on someone else's behalf.