You are right, this is not a discussion worth having when you can do the experience. If you have a digital synthesizer, just try the experiment that I describe and listen whether you can tell the periodic from the non-periodic waveform. You say that they are perfectly distinguishable, but I just did the experiment (even drawing the lissajous figures) and there's no real difference except the perceived pitch.