You do not have a right to take someone's capital from them without their consent. You also do not have a right to privacy that you voluntarily give up. This is really basic logic, that you're failing at.
You want a society where everyone in the world has to unanimously agree with every decision you make for it to be consensual, which makes for a totally unworkable world model, which describes socialism in a nutshell.
Yes, I am aware that the seizure from natives of the trillions worth of real estate the US is built on is not considered any infringement by libertarians. Their liberty is not worth considering nor defending -- and that comes with the territory of a toy political philosophy that loudly pretends it isn't built utterly upon coercion.