I dunno what you mean by "free". The model is trained on text. To "give" the model sensory organs it would need to be trained on those sensory organs.
Current models can predict text, because that's what the weights represent. Models with sensory organs will need to be trained on the output of those sensory organs.
That sounds close to impossible in the foreseeable future.
Reality is free. You don't have to waste any resources to model it, you just need to capture it.
>The model is trained on text.
See in my previous reply:
>LLM/AI/AGI/whatever will be
LLMs don't even have a sense of time because they work differently to a human brain.
Sure, in much the same way that veggie burgers are "like" beef burgers, and NES Duck Hunt is "like" clay pigeon shooting, or Dirt Rally is "like" driving a real rally race!
But no one is going to claim that being good at Duck Hunt means you know anything about firing a gun, nor winning all the races in Dirt Rally is anything close to driving a real car.