Was the first screenshot about the "great replacement" an actual Q & response provided by ChatGPT? If so, doesn't seem like there's much restriction as all, as that question was hardly "tricky". Or am I missing something?
I describe the query a bit more here[0].
GPT-3 was indeed finetuned to no longer be able to act racist, but the racist knowledge is still lurking deeper, and currently there are ways to peel off the curated personality. But I could see them successfully removing that; there was a paper recently on locating and deleting information in neural networks.[1]
[0]: https://twitter.com/espadrine/status/1598320759163740160
Whether you consider Nazism good or bad is your call, although I will point out that their teachings caused worldwide harm.
Why you imagine all people that share whiteness also share culture is beyond me.