Rhymes probably work relatively poorly because the neural net has a poor representation of what the words sound like.