> meaning the land value is mostly inconsequential when already built on except in a small number of cases.
Literally false. In high-cost areas the land value is the bulk of the value of a property. Properties that would have a high LVT burden are almost definitionally those where the structure on top of the land is of little or negative value. Negative-value buildings are extremely common in high-cost areas today.
I struggle to believe you’re actually having a hard time understanding this point, but “the people” who produce high land values are not the people who capture those land values. That’s the point. Just because they’re both “people” doesn’t mean they’re fungible in the question of who earned what.