According to Wikipedia [1] the science is not as settled as I thought but my understanding is that from the nerves needed for breath control to various vocal apparatus, erectus’ speech would have been primitive at best. Speech, however, is not the only way to express language.
An innovation in spoken language is one of the theories used to explain the Great Leap in modern sapiens.