Not really; it's a conflict between two groups and sets of rights.
I have the inalienable right to not be defamed and defrauded.
Now we have to resolve the contradiction as a society. That it's sometimes messy doesn't mean we ditch the concept of rights.