I think it has to be immediate and public. That doesn't mean severe or disrespectful. Everyone has to do it, but it certainly should be set up from the top down that this is unacceptable and will stop.
I take a page from the Results Only Work Environment: http://www.rowe.iambestbuy.com/sludge_busting.html