Gatekeepers are going to be gatekeepers. Some folks rely on the nerd persona to look like the smartest person in the room; they probably picked that identity up at an early age. When they see an intelligent person who doesn't fit the stereotype, it can make them uncomfortable.
But those people are rare. For everyone else, it doesn't matter.