If your cost of living is higher (due to LVT), the minimum wage you will work for is higher. The amount of discretionary spending (someone else's income) or investment you can make is lower. Obviously these effects on an individual level are small, but when aggregated across the entire economy are very large.
In a world of LVT, everyone pays LVT because everyone lives somewhere. You either pay it as an owner or its passed through to you in rent prices. It will be passed onto you in the food you eat (which was grown on land), in the products you use (which were manufactured in a physical place), in the internet services you use (which are run on data centers on physical land), and so on.
In this way, it is much like all other taxes. What is special about LVT, and not other taxes, is that LVT create a disincentive against land speculation (using land as an investment rather than for living or productive use).