I actually achieved the same, with benefits.

The hack is here: https://github.com/any1/wayvnc/issues/7#issuecomment-6570922...

Benefits are: two way interaction :)