The reason that most taxes can be passed on is because as price is raised, the supply and demand curve is pushed and less is made. With land, there is a finite supply, none can be created, none can be destroyed, so land value taxes can not be passed on.
As the land value will always be zero, there is little value in holding land that you are not using productively, so speculation will drop heavily.