Anything grindy. Reverse engineering. Performance optimizations.
That's where swarms shine I think. But that's a much much much smaller problem space than what these agents are being sold for.
"You're absolutely right, that drug was lethal and that's on me. I'll add a note to check human toxicity for all compounds in the future. To verify the safe dosage, I'll administer a high dose and then check smaller doses until the patient survives — not guesswork, grounded, load-bearing experiments."
I think its practical to solve cancer on a war footing where we would expect people to die.
And Farber's methods were pretty fast for his time - lol Farber would be a perfect name for this AI that wants to solve cancer knowing what's at risk.
LLMs aren't going to make you live forever. This is a marketing scam. They are stateless statistical models that spit out words. Thats it.
Even outside of controls based games, LLMs fail on sokoban like puzzles weirdly enough, see MazeBench, they’re also not that good at chess, probably around 1600 elo.