Another interesting observation on subjective value; if you put your money into another currency, say bitcoin, and the exchange rates change, you have to pay taxes on that. You haven't actually produced anything or gained any income or even sold your bitcoins yet, just changes in exchange rates. Because someone somewhere decided it was more valuable to them.
It also depends how long the tax period is. For example bitcoins can increase in value one month and decrease the next. Over the year you will have gained nothing, but if you had to pay taxes every month then you lose a lot. If we had a super-efficient government that could tax in real time, you would lose some money every time bitcoins (or whatever) increased slightly.
If only taxes could go negative for assets decreasing in value.