Yes and no. Sometimes we think in words and sometimes we think in images.

We can think about an object we have seen but don't know the name of.