What would be Orwellian is a university ordering its students "we will invite speaker A to come talk to you on the big stage, and you have to sit there and listen".
You presumably also think that it'd be free speech to deny your math class hearing the math professor by non-stop screaming?
Nobody is going to stop my free speech about how integrals are not real because infinities don't exist or something. But that's not the same as giving me the right to shut down all speech about it but mine. So yes, I will be taken out of the classroom specifically set up to hear about integrals, for that.
Can religious people prevent your whole school from learning about evolution? That would literally fall under, in your words, a university ordering its students "we will invite speaker A to come talk to you on the big stage, and you have to sit there and listen". Not forced at gunpoint, but at grade-point.
Can I forever shut down a theology department by showing up every day with a bullhorn? Is that free speech?
Would it be free speech to give literally everyone a heckler's veto?
I really think you need to refine your question.