Yes, which is what makes it so bad. Somebody else's cash payment subsidizes my credit card rewards.

Most places only charge extra fees for credit cards in Japan.