That sounds about right. In another comment, I cited a story about how we closed public pools en masse when they were becoming integrated[1]. People would rather have no public goods at all than share them with people they look down on.
1. https://www.marketplace.org/2021/02/15/public-pools-used-to-...