It's actually even more annoying than an Owl City song that doesn't oscillate from left to right behind my head.
I think one aspect of it that adds to the annoying experience - it's as if the music is lurking around in your personal space right behind you, which is really irritating when a person does it.