more importantly, people can make perfectly intelligible speech using a completely different set of symbols, for example writing, whistling^1, hand gestures (sign language), pictures, etc.

Of course language is purely neural!

^1 https://en.wikipedia.org/wiki/Whistled_language