Except that you're not "literally taking money out of their pocket for that day" - that would imply that the money was rightfully theirs, and that you've essentially stolen it from them by not tipping. That's not how tipping works - it's the customers money, given at their discretion. There's a strong sense of obligation felt by most people, but it is ultimately optional.