Until the last election, it was random crazies that weren't mainstream. In fact, McCain shut them down at rallies when they mentioned it. Romney didn't shut them down as forcefully but he didn't actively partake in it.
I'm certain the crazies weren't entirely random, just as the sudden rise of the Tea Party at the time wasn't entirely grassroots.
Donald Trump was a large part of this disinformation campaign. The whole Kenyan birther campaign was a racist dogwhistle.