This is something that I've been told over and over - early exposure to things like dust, pollen, nuts etc basically eliminates allergies when older.
As an example, I was never exposed to cats early age but dogs yes. Now I have a mild reaction to cats hair and nothing with dogs. Of course this isn't a scientific study that can be validated but it does sort of make sense in my mind.
A la antibodies etc.