Now math isn't my wheelhouse, but every LLM I've seen provides far more than just the final answer and is quite willing to answer questions.
Now math isn't my wheelhouse, but every LLM I've seen provides far more than just the final answer and is quite willing to answer questions.
Imagine you are Euler and magical Djinn's exist (that possess all mathematical knowledge written up to that point exist and function identical to LLMs). You ask it to tell you answer to the bridge riddle and it says that's not possible and even gives some plausibly sounding examples even. Then it throws a 11 pages of gibberish proofs at you, which are all true but very convoluted.
And what if you start digging into it? Won't other people say - "Hey Euler go back to ploughing the fields? We can have Djinn's answer all the math questions but this field isn't going to plough itself."
Today's, the Djinni-Euler's equivalent of someone looking at LLM's Navier Stokes equation proof.
Perhaps they would discover new Liquid Set theory that would turn Liquid dynamics from a field fraught with problems into a beautiful mathematically simple meadow.
Seems like an overly pessimistic take to me.
If you have a magical Djinn happy to answer questions, why wouldn't you badger it a bit for the details? I can't imagine Euler of all people just wanted the answer.
Remove the human theorizing and the LLM won't be able to fill in that gap. All it can do is remix. It cannot formulate and, equally importantly socialize new mathematical theory. Without social acceptance and promulgation theory is meaningless. I might have a private "sort of graph theory but not" studying a slew of new mathematical objects called quizzgams, but if I cannot actually articulate this theory to anyone and get an active participatory body of people around it, it's pointless. Any "theory" an LLM can create de novo is such a theory. Because, again, it doesn't actually produce novel thought, just novel byte sequences. A thought is more than just its encoding, it is processual and social, which all the nerds and vc bros seem to not understand.
If I were a Claude instance, rather than a software developer fielding these questions as a small component of my job, could I take a step back and instruct them from first principles until they do understand? Maybe. But maybe there’s just too big of a gap to be crossed in one step.