It happens to me occasionally (I'm male). Unless I'm making a conscious effort my face normally looks sad or down and people tell me to smile or cheer up. It really annoys me when they do that too.