Here's the kicker: In the US, if you don't buy with a credit card that earns you "rewards", then you are subsidizing those who do use credit cards with rewards. The reason is because many credit cards give around 1%-3% back, but the prices for everything remain the same regardless of whether or not you pay with a credit card that gets you rewards. As a result, built into the cost of nearly everything, is the cost of providing the airline miles, points, or cash back rewards.
On top of this, credit cards provide you with protection because you can dispute charges, and if someone fraudulently uses it, you do not lose that money immediately. Also, some cards (like American Express) provide 1 year of extra warranty for anything you buy.
TL;DR It's better to buy with a credit card, it costs nothing (individually), and you get benefits. There is a cost to society (everything costs a few % more), but I don't see that changing anytime soon.