If the algorithm is trained on English words, it will learn English phonotactics (i.e., syllable structure, what sounds are allowed at the beginning of words, etc). That makes it much more likely to generate valid words, as the set of strings that follow English phonotactic rules << the set of gibberish strings.