Why must you say anything at all? This is a centuries-old meme that serves no purpose. It annoys me slightly anytime says it to me, and I don't say anything to anyone else when they sneeze.
That you choose to get "annoyed" about such things is your problem, nobody else's.