Spirits are considered intelligent even though they have no body because they are composed of pure non-physical consciousness. Plants are intelligent even though they also have no brain.
That fundamental sort of living conscious intelligence isn't what I see discussed much in these contexts though.
What you will notice about it though is that unlike frozen LLMs, this type of intelligence also has the capacity to change, interact, and learn from its environment.
If we go with this definition instead, then on a large enough timescale everything can be considered intelligent, even rocks.