Free speech does not mean consequence free speech. It's not some gross injustice that saying racist things or supporting racist candidates makes people think you're racist.
Creating consequences for speech just pushes the speech underground where it can't be challenged. Then when someone like Trump pops up people wonder where all the support is coming from.
You're completely missing my point. Did you read the whole post or just the first sentence? My point was that people shouldn't be punished for saying reasonable things, but currently they are.