I've got a full head of very thick hair but it comes out of my chin and the sides of my face.
Imho the reason young men worry about losing hair is because they think it will have a negative effect on their sex life as you grow older you realise that women prefer wealth confidence and dominance within the social group over hair.