I didn't perform serious testing on latencies below 100ms yet. I've added to my todo that we should investigate the minimum supported latency.
I wish you luck with your project! sorry if my comment was snarky but a lot of modern software seems to essentially not care about latency or responsiveness, and it's something that bothers me more and more these days