> as long as it does not infringe the rights/freedoms of anyone else

that seems like the hairy part

Like freedom buy from slaveowners and to dump poisons into the environment, as long as you don't interfere with others freedom to suicide or starve or clean the poison.

And freedom to define those rights/freedoms as you see fit.