Well.. you're paying a 2-5% higher price, but the merchant gets to keep all of that; it's not as if they have to also pay that fraction into their transaction processor.
> I suppose a well-functioning competitive market
You ever see retailers that offer a discount card? Like, spend $50 here get $10 off in the future? Typically they'll only offer those for cash transactions. This is why.