1,518 karma · joined August 27, 2022
I personally (caveat: in math, not science) always found the writing part more pleasant and exciting than the research part. In research, I was always anxious that I won't have any idea, or that the proof idea won't work. In writing, I was relaxed that I had obtained a result so I got excited about how to write it up beautifully.
A lot of people have dismissed LLMs four years ago for this reason. "It cannot possibly do coding since it doesn't think, it just predicts the next token." On the other hand, Scott Alexander did say in 2019 that next token prediction is a brilliant idea and might cover a lot, including math proofs [1]. So I wouldn't say it is impossible for either 1) LLMs to be all the way to AGI or 2) LLMs to become creative enough to tell us what the AGI architecture is.
[1] https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward-g...
Sometimes it pays to attempt the impossible.
To be clear, I am also criticizing myself, I was an avid Microsoft Word user back then.
Of course if you solve any existing problem, new ones appear. That's not the point. The point is that AI will be able to advance on any problem better than any human.
And it was dangerous.
Also: I grew up just before cellphones started to be a thing and I felt a lot of times as a kid the frustration of not being able to contact someone remotely.
Why? o1 was released in late 2024
In 1-2 years the AI will give an instant answer to most conjectures anyway.
Probably this will be done in some form in the coming months.
I guess the idea that AI will do all the work and either take care of us or kill us all. Which will probably happen, but the transition takes years and in the meantime we work much harder. People were expecting a fast takeoff.
Why write more than a book instead of just putting everything into one book?
This is a way of thinking from which it is hard to get out, I have no idea how to point it to you.
The flagship case is AI itself, where we rely on benchmarks, not proofs (how could one prove "is good at seducing people").
Something that could have qualified as a "CS discovery" would have been, for example, a SAT or SMT solver that dwarfs in performance any existing one.
Something that could have qualified as a "physics discovery" would have been a new particle. Anyway, something that would come out of experimental data.
About the fact that people may tend to judge people as characters in a book and not as real people with influence.