>Even this example, what sources do you trust that is or is not "in the readers best interest", what is propaganda or what is an implicit value in a society, when you tune an LLM does that just mean you're steering it to give answers that you like more?
You tune the model yourself. You tune it to find the things you're looking for and which interest you.
>Creating an unbiased LLM is as much of a fools errand as creating an unbiased news publication
It's what you do before pretraining. You model human-written texts with metadata and context with the intent of actually modeling those texts, rather than excising something which isn't just causing the model to fail to learn other things.
It's like, asking "what's a cake, really". We can argue about lines etc., but everbody knows. An unbiased language model is a reasonable thing to want and it's not complicated to understand what it is.
Can you imagine unbiased courts, as an ideal? Somebody who just doesn't care about anything other than certain things? Just as such a thing can be imagined, so can you imagine someone who doesn't about reality and just wants to understand human texts.