Sure we're starting to give chat bots the ability to query information and even interpret user-provided images, but AFAIK the image interpretation is done using a different model rather than being an extension of the LLM.
Sure we're starting to give chat bots the ability to query information and even interpret user-provided images, but AFAIK the image interpretation is done using a different model rather than being an extension of the LLM.
Their prediction abilities stretch beyond just language even if they're only trained on it.
https://general-pattern-machines.github.io/
There's nothing specialized about being able to predict meaningful completions from arbitrary token sequences.
There's a whole lot that can be done with that even if they were constrained to language.
https://tidybot.cs.princeton.edu/ https://innermonologue.github.io/
There's nothing stupid about GPT-4. There's no testable definition of general intelligence GPT-4 would fail that a chunk of humans also wouldn't.
Vision understanding does not have to be a separate model. https://arxiv.org/abs/2306.14824