Without a human in the loop LLMs tend to brute force things they don't understand.
They've been super useful to me when comparing datasets during a porting process.
But if they don't have that loop, then they make assumptions and build towers of madness on top of said assumptions.
Fundamentally if I am paying for these tokens, I should be able to see them but that's not where we are right now.
Like, it's wild to me seeing majority Chinese ML teams for years in the Bay and elsewhere that suddenly in the LLM space they are only capable of competing by stealing the hard stolen goods of our frontier US developers.
And the naming... 'Anthropic' & 'OpenAI' are such misnomers, that's not an accident.