I've been in that situation, and it did bother me, because I felt like my compensation did not reflect the level of my contribution. After trying to make my case and fail to convince management that I shouldn't be paid less than those who contribute less than I do, I lost interest and left for a new, much better paying job.
Being paid fairly for the work you do and effort you put in is different. I'd absolutely be annoyed if I didn't think that my pay reflected the workload and effort required.
Part of the reason I'm happy with my salary is there's a lot of the time I feel like I'm being overpaid for the level of effort and knowledge required.
Also, the benefits / working hours / commute / where you live can play a massive difference in your 'real' wage. Our household income is ~£65k in Manchester and we worked out we would need a household income of around £100k+ to live as comfortably in the South East. That would also probably require a much longer commute than I have now unless I wanted to live in a smaller house.