I disagree that we’re talking about rights at all. I think the issue is really norms and expectations. Do we really need to invoke the heavy hand of law and government as the ubiquitous standard for what is acceptable?
As Chesterton argues to the contrary "To have a right to do a thing is not at all the same as to be right in doing it."