Will GPT-4 Run Doom?

This is a nice read and an interesting concept.

I'm also sure that improving an LLM with some extra sauce that doesn't rely on token generation and making it better at handling such tasks as playing Doom is the next step.

With LLMs we've built a better "language" brain than a human, now we need to build and research all the rest.

Just pumping more money in LLMs will yield low returns, but it's the hype of the moment, can't wait until it crashes so we are back to real science.

I bet Sora can "run" Doom.