Are you sure you're not confusing the phonology of Chinese with that of Japanese? Because I have studied both, and what you say is true of Japanese, but most English-speaking people seem to find the Chinese consonants represented in pinyin by zh, ch, q, x and r quite challenging. In addition, the tones have no English equivalent, and are a bit of a bear for an English speaker to keep straight.