What's worse, because the vast majority of merchants charge you the same price whether you're paying cash or credit, people who pay cash are, in effect, charged these hidden fees as well.
If people stopped using rewards cards, and the merchants didn't have to deal with the associated fees, the cost of the merchandise would arguably drop by the same percentage as what you're getting back in rewards.