This is my situation. I use sway for this reason and it’s just about okay if you’re not on Nvidia.
Screen sharing is the main gripe, it’s a pain to configure, involves a lot of different bits of software which have to be orchestrated and none of them are mature enough not to break occasionally in an unexpected fashion.