My manager does this. My managers' boss does it to him. One of the very few complaints I have about my management or my job.

I've sort of become inoculated to it though. Was tough at first though, especially since I have some (undiagnosed) manner of anxiety disorder. So the joke would happen and I would think about it for the rest of the day, if not longer.