You can't. No one person can. That's why centralized economic planning doesn't work. (I'm not trying to suggest that Georgism is centralized planning, or that Georgism doesn't appreciate the value and necessity of price signaling.) And private ownership doesn't necessarily lead to the most efficient allocation. But the point is that private ownership is a stable regime. There are an infinite number of regimes that would offer better allocation, but we haven't yet seemed to find one that is stable, or that we can make stable. (A big part of the problem, I suspect, is cultural, so I don't mean to suggest that Georgist systems are inherently unworkable, just evidently unworkable in recent American history. I think our social and political cultures play a big part in what make land value taxation seem unfair.)
That said, if the public believes land isn't being put to good use it can purchase the land at market price.[1] That still leaves accidental and speculation profits in private hands, but theoretically it puts a ceiling on inefficient allocation. Unfortunately, in some ways (particularly politically) eminent domain powers are at their nader in the U.S. Which is a big part of the reason why we can't accomplish things like California Highspeed Rail. I think that drives home the point that Georgist taxation is less workable today than it ever has been in recent history.
[1] That's required by law in some countries, like the U.S. In some other countries it's not technically required by law but it's often the case that the government does pay market price, simply because to do otherwise would seem unfair and lead to political backlash.