It's not solely about the inner voice. Abstract concepts, symbol manipulation, mathematical logic and reasoning are for the most part "linguistic" constructs.