I've noticed sometimes when talking to a stranger of the opposite sex that it is normal to keep eye contact, but sometimes I notice that there eyes wonder and are in the direction of your lips/mouth area.
I notice that women look at my crotch. They notice I look at their chest. All works out well. Worry less man, it's all good.