The useful thing I actually want to do with this: Zero-latency ssh.
1. Train a smaller (<10M-50M) model. Lower accuracy is fine; I want latency <10ms.
2. Then create a "reactive" version of `ssh` that gives you the perception of zero latency over shitty networks and high latency ssh connections across the world. Basically, the local screen should respond instantly to my keystrokes (including how arrow, tab, etc. esc keys respond in various TUI apps), and then correct itself when the server actually responds.