What is fair? For people that can save most of their money, VAT is a neglible proportion of their income. Poor people which spend all of their money (and more!) will pay a lot of VAT proportional to their income.
The first person might pay more in absolute terms, but that doesn't sound fair to me.