An GAN that just made verbatim copies from the training set would not be able to smoothly interpolate in latent space. Also, see Fig. 10 in the paper at http://research.nvidia.com/publication/2017-10_Progressive-G....