Recently did the exact same thing and came to the exact same conclusion, even if code server worked well enough the lost screen realestate pissed me off so much I don't think I could have lived with it.

There is a hack to get background ssh connections to stay alive: https://docs.termius.com/faq/troubleshooting/cant-run-in-the...