While semiotic has become something of a joke, it has been seriously investigated[1]. We don't really think in language or even in symbols, it's rather a lot more complex than that.

[1]https://plato.stanford.edu/entries/peirce-semiotics/

It is not contradictory to maintain both.