Yes, the shitheads will go where they are tolerated. So do people who aren't necessarily bad people but still want to share opinions which may be outside what is currently the orthodox way of thinking. If that alone makes someone a shithead to you…
But if you really don't want to see arguments about Jews or whatever, just don't follow anyone who posts that. And if someone you follow does start with that stuff, just unfollow them, perhaps block them. In that manner it works the same way as on Twitter; once you have a solid base of sane people you're following, it's hard to just stumble across content that upsets you unless you're actively looking for it.