I don't think it is a paradox. As soon as your practice of free speech limits other people's ability to practice free speech, you are not actually practicing free speech, but attacking people's freedom of speech.
Context matters here, I think:
If I said "The president should not be allowed to say this", this would most likely not affect the president's freedom of speech.
If the president said "ls15 should not be allowed to say this", this may more likely affect my ability to express my opinions.