I doubt that would actually occur. People with deep pockets could buy it up because they don't care about the tax. They'll just pass the cost on to renters anyways.
As the land value will always be zero, there is little value in holding land that you are not using productively, so speculation will drop heavily.
You say all this as if there isn't any meaningful supply-and-demand to be had in the secondary market.