In your statement above you bemoan that without absolute rights we must "constantly debate where _the line_ is"
Here you concede "those are all good questions that need to be carefully considered".
...so we're right back to debating where the line is.
I'm not seeing a coherent argument here.