It wasn't catastrophic to the British economy. Why would Switzerland be so different?
For Switzerland it would be significantly worse since they are surrounded by Germany, France, Italy, and Austria. So all trucks would be stopped at border. Food prices are already super expensive and this would make it worse.