LLMs also have other inputs, like audio and images. They get encoded (just like a human eye encodes an image) and passed to the weights.
LLMs have the same fundamental input regardless of modality, tokens. There is a preprocessing step before the “brain”, which is more akin to some super-synesthesia where all senses are translated into sound before becoming experience.