Well, no, that isn't freedom of speech. That's the 1st Amendment, acknowledging the existence and inalienable nature of freedom of speech.
Now suppose he were already invited to her domicile, but she and Bill found him annoying so they told him to either stuff it or leave. Would that violate his first amendment right? Also no.
Now replace the Clintons and Shkreli with Stanford and the protesters, respectively.