What is the connection between "well behaved" users and non-racists (or whatever)? Cannot racists be well behaved and non-racists (what is the opposite of racist?) be badly behaved?
I mean, sure, people will leave. But if you aren't interested in discussing something that would be opposite to your beliefs and opinions then why would you participate in such a forum in the first place?
It is right there in the purpose of the forum: a place to discuss highly unpopular ideas and opinions. Who would join such a place and expect it to not be met with discussions they'd dislike?