It's absolutely annoying and makes me think less of businesses that ask. However, I just say "no" and they drop the issue. It's not that big of a deal, it's just another in the growing list of annoying things about restaurants.