Yes, but unless you're considering some means of achieving those social norms, even if that's just social pressure, it's unlikely to change anything. And when people do actually advocate means of changing the norms of discourse, people who don't like the proposed changes will call it censorship.
>They are called ideals because we cannot perfect reality, not because they are unimportant. There's nothing wrong with forming consensus about how things should work
I agree. The point I'm trying to make is that in practice "Freedom of Speech" is not actually a very coherent ideal.
If we just mean the government should not directly intervene to prevent speech, that's a reasonable ideal, and relatively few people actually disagree with that. But when people try to consider other ways in which speech is controlled, they still call it "Freedom of Speech", even when arguing for contradictory things.
And I'm arguing that the reason for these contradictions is that the debate tends to be framed in terms identifying speech restrictions and acting to remove them, rather than asking broader questions about the inevitable ways in which speech is amplified or silenced, and how we should structure discourse within those limitations.