The safety here is not just "don't mention potentially controversial topics".

The safety here can also be LLMs working within acceptable bounds for the usecase.

Let's say you had a healthcare LLM that can help a patient navigate a healthcare facility, provide patient education, and help patients perform routine administrative tasks at a hospital.

You wouldn't want the patient to start asking the bot for prescription advice and the bot to come back with recommending dosages change, or recommend a OTC drug with adverse reactions to their existing prescriptions, without a provider reviewing that.

We know that currently many LLMs can be prompted to return nonsense very authoritatively, or can return back what the user wants it to say. There's many settings where that is an actual safety issue.