I’m assuming they have much more control during training and at runtime than us with our prompts. They’ll bake in whatever the person with the checkbook says to.
I think someone should create a leaderboard that measures how much the AI is lying to us to sell more ads.
We do this when using LLM in our apps too in much less sinister ways. One LLM generates an answer and another applies guardrails against certain situations the company considers desirable.