Look, it's a lack of goodwill. The student exchange could easily stay in place, it would be trivial to set up an agreement and if there are costs the EU would have to bear as a consequence, Switzerland could pay it. There aren't that many students.
But no, that's not what happens. The EU uses this as another bargaining chip, so it has the students and university faculty in its pockets. The strategy is obvious, and anyone who does not look through it is blind. No, don't sell Switzerland out. Autonomy is much more valuable than a couple of financial and contractual bribes.