HNHacker News
TopNewBestAskShowJobs

sudokuist

3 karma · joined September 2, 2023

submissionscomments
sudokuist··on Recursively summarizing enables long-term dialogue memory in LLMs
They don't have 9x9 puzzles. Any guesses as to why they only tried 3x3, 4x4, and 5x5 but not 9x9?

This work is interesting. I wouldn't have guessed 3x3 puzzles would be solvable by a large Markov chain. It would be interesting to know how large of a context is necessary to solve 9x9 puzzles. No existing model can currently solve 9x9 puzzles even though the recursive backtracking algorithm can solve any given puzzle in less than a second.

sudokuist··on Recursively summarizing enables long-term dialogue memory in LLMs
Perhaps.
sudokuist··on Recursively summarizing enables long-term dialogue memory in LLMs
Turns out Markov chains with a large context can do a lot and yet no one has figured out why LLMs can not solve sudoku puzzles. Why do you think that's the case if the goalposts have moved so much?
sudokuist··on Recursively summarizing enables long-term dialogue memory in LLMs
Have you tried formalizing your ideas with Isabelle? It has a constraint solver and will often find counterexamples to false arithmetical propositions[1].

1: https://isabelle.in.tum.de/overview.html

sudokuist··on Recursively summarizing enables long-term dialogue memory in LLMs
Example?
sudokuist··on Recursively summarizing enables long-term dialogue memory in LLMs
No one knows how the brain works and how it is connected with the body. Did you know your gut is directly connected with cognition? An unhealthy digestive system has been linked with several neurodegenerative diseases. Also, walking and cardio in general is known to create new neurons and prevent cognitive degeneration.

It's always funny to me when people on online forums confidently proclaim to know what cognition and thinking is all about and that furthermore it can be reduced to symbol shuffling on computers. No one has any clue how to make computers intelligent and anyone that claims to know is either doing marketing for some "AI" company or thoroughly confused about what counts as biological intelligence.

sudokuist··on Recursively summarizing enables long-term dialogue memory in LLMs
Can LLMs solve sudoku yet?