The "chirping" artifacts are quite distracting. I wonder if they can be avoided by randomizing the alignment of the final piecing together of the audio?
Post-processing by convolving with a short noise burst removes them pretty well, as that randomizes phase vs. frequency.