You can actually see the same dynamic playing out with Swiss access to the EEA: https://www.euronews.com/2021/05/27/what-s-the-future-of-eu-...
The debate doesn't seem to be being carried out in quite such a stupid way as it was in the UK, but everyone is clear that it's the public objection to immigrants that is the flashpoint.