How much do you want to bet that an LLM with the ability to search the web and write python scripts would smoke the best humans at chess and MTG?
How comforting is it really when it’s not the bare LLM beating you, but the LLM using tools it created?
How comforting is it really when it’s not the bare LLM beating you, but the LLM using tools it created?
Even if that were true, humans don't need to search the web and write python scripts to play a competitive game of MTG.
The particular problem here is it's not addressing the intelligence spikiness between individual humans. Most humans aren't going to play a competitive game of MTG, a small percentage will rise above the rest and dominate.
Also this is being intelligence blind. Most humans could never write a good python script to play a competitive game of MTG, almost any SOTA model can.
This would be like a bee saying humans aren't intelligent because we can't see in ultra violet, where as we're damn good at making tools that can.
I don't understand this argument, it’s not like humans and LLMs are engaging in some kind of competition with strict rules where ONLY the raw LLM responses “count” or something.
No. The current frontier models would not beat the best humans at MTG, even with Python scripts and web search. Unlike Chess, there are no existing engines that beat humans.
That makes me a good engineer, but not good at chess, and definitely not super intelligent.