I think you have failed to understand the paradox.
Context matters here, I think:
If I said "The president should not be allowed to say this", this would most likely not affect the president's freedom of speech.
If the president said "ls15 should not be allowed to say this", this may more likely affect my ability to express my opinions.