I'm sure I can sort of prompt it to try to give the answer I want but some people talk about "I don't want an LLM with a political perspective, just provide all the perspectives equally and without bias."
And to a certain extent they have to be constrained. Anything more than a 500 word response I'm probably not going to read, particularly if I want to go deeper on something I want to navigate the conversation. But it means that tuning things like sycophancy just create sort of extremely simple mitigations. Even when I say "May" or "slight chance of" I'm often corrected "Be careful to make too blanket of a statement." I wonder if part of this has been the move towards optimizing towards the agent experience.
Likewise a bias towards "Say things equally without bias" is an exceptionally poor way to actually explore the nuances of an idea, with this sort of regression to the mean.
I don't know if they'll be able to solve this problem broadly. I mean, LLMs probably shouldn't be therapists/coaches/philosophical gurus. But I could anticipate a growth in sort of groupthink and regression to the mean in terms of perspectives broadly speaking as a society.
I find them useful. Maybe it's better I find them distasteful to talk to as well.