In other words: There's a reason for zoning.
The U.S. is actually pretty lax, on average, in terms of zoning compared to some other parts of the world, though it is certainly a state-by-state thing.
It's really not fair to lump zoning in with things like civil forfeiture.