Language has become synonymous with intelligence, not only in AI, but just regular I. It is a means of transferring information from a source to a sink. If the sink is intelligent it will be able reconstitute the ideas that were transferred too it.
We consider animals less intelligent because almost none have the ability to transfer intelligence via some other medium.
You're also hitting on a problem with the word intelligence and the fact it's about all encompassing as the word universe. There is cellular intelligence encoded in RNA and DNA. There is multicellular intelligence between organs and different components. There multiple layers of the mind, one part for organs and constantly running system, one for locomotion, and another for abstract thinking. Trying to lump this as one thing makes it very difficult to understand the capabilities of a system.
Also, you're not paying much attention to LLM enabled robots these days. For example some of Google's larger robot models can travel into a room they have not seen before and look in cabinets for an object they have not seen before and successfully find it.
Not a good time to be in denial about evolving robotic capabilities.