I know it can't be this but can't help wondering if it's the same problem digital audio systems have when you stopped playing something without returning the speakers to amplitude 0 :) The next time you play sth there's a loud bang because you return to 0 instantly :)