mpodeley

Well, that completes the grey goo bingo card.

“Next-token prediction” describes the output format, not the computation required to choose each token. During training, models develop internal representations of concepts, constraints, possible futures, and algorithms.

The PCB agent also writes circuit code, runs simulations, reads failures, and revises the design. It isn’t one-shot autocomplete.

Astra and Fable are already hard to square with “mere autocomplete.” We may be (really) close to AGI, and token-by-token generation certainly doesn’t rule out subjective experience (I think we should at least treat that as an open question).

Great videos: https://www.youtube.com/watch?v=D8GOeCFFby4

https://www.youtube.com/watch?v=Bj9BD2D3DzA

https://www.youtube.com/watch?v=l6DKRf-fAAM

https://www.youtube.com/watch?v=GlYgs6v2YfU