Thanks :)
I play piano and I don't find the latency a problem, which means its probably < 100 ms. The midi stuff is actually just bindings to rtmidi (in C++).
The most annoying thing is "jitter" which I calculated to be 15-20 ms, which is fine, but sometimes there are spikes of 50 -150 ms which are annoying.