Here's the thing that you're forgetting: the targets of (e.g.) hateful rhetoric feel better when bigots are dismissed from polite society. Some bigots may become more radicalized, but many become demoralized or may even think twice about it (see above). However, when fewer people are allowed to propagate bigoted views in society, society overall is a better place. The whole point is to make society more inclusive. I care less about marginalizing people with abhorrent views than marginalizing different ethnicities, lifestyle choices, and genetic predispositions.
"Wait until they die" suggests a bootstrapping problem: why would children of bigots feel any different unless they had a reason to? If you only wait for bigots to die out instead of marginalizing them, bigotry is normalized over generations. You have to interrupt that cycle.