I hooked up scrcpy to opencv once so it could play a game for me: https://github.com/robberth/scrcpy-opencv

Not the prettiest but it worked :-)