Lessons learned building a sub-100ms remote control app with Rust and LiveKit

gethopp.app

5 pointskonsalexee2 comments

Interesting post. Curious though why you did not stream directly from Tauri (as you say you used to build the app) and you are sharing the screen from Rust. Was it because you had higher latency?

Costa here, one of Hopp builders.

We chose to go native with Rust instead of just using the screen-sharing provided from Webkit for a few reasons: 1. Granular access to OS APIs. For example on MacOS you can select applications that you want to exclude from screen-sharing, which we know we want to use in the future. https://developer.apple.com/documentation/screencapturekit/c... 2. Being able to tweak the WebRTC client. In our case we patch libwebrtc for minor bugs, and tweak parameters to allow lower latency in video streaming 3. This: https://github.com/tauri-apps/wry/issues/85

Reply on news.ycombinator.com