Because you had done even a single Google search and turned up, for example this paper: https://aclanthology.org/2022.ltedi-1.6.pdf titled "Detoxifying Language Models with a Toxic Corpus" (Yoon A Park and Frank Rudzicz at Toronto), which while not exactly groundbreaking, is a well-footnoted exploration of how to use adversarial or quasi-adversarial training ensembles in a language setting?

To be clear, I'm aiming for a tiny amount of snark/sarcasm above, the minimum amount. I want to provide a useful answer, but I'm a mechanism designer by trade and incentives matter. Don't do that.

The rest of my snark is at the offices of The Facebook, where people smarter than me are doing work that no one writing this comment, including and especially myself, are intellectually or creatively capable of ;)