Property tax doesn't adequately tax the value of the land. That's the whole point. This was a vacant, unbuilt lot in the heart of New York City. For ~thirty years. That shouldn't even be a thing ever.
Currently the building pays about 20M/yr in property tax. Having a vacant lot there for three decades is many millions in property tax that the city never recieved.