This sounds feasible, this is how I would do it to save on costs. But then it can be a bad user experience. And as far as I know, you have the virtual background even when using a potato to stream.
Maybe if the device is not good enough then they push it to the server side?