Money that is not required to be paid cannot be called a tax. Taxes are not voluntary. Things like tax avoidance don't even exist, by definition of the word.
If you buy consumer goods in a low-VAT place but transport them to a high-VAT place and consume them, then that is clearly illegitimate for the same reason that it is legitimate for VAT to be applied to imports and refunded to exporters.
Within the EU definition, VAT taxes the company making the sale for the increase in value of a product through the processes the companies and distributors applied to it, and is not a taxation of the receipt of said value.
There is nothing illegitimate about then consuming the product in a different country. It just doesn't happen to send money to your own country's treasury.