Well nevermind! The HN community just literally solved my complaints!

I’ll set up my users as managed and pay for them, that’s really perfect. Since all users are accessing via a vps I control I can just whitelist that and my home networks CIDR and might be back in business!

Thanks for the help folks!