Game tick is usually 16ms, so a nanosecond latency is 7 orders of magnitude faster than needed.
Minecraft runs on 20 ticks per second so 50 ms
Why not go the opposite direction? Reduce game ticks to 1-tick per second then simply "playback" the game in a speed which feels normal. eg every 24hr of wall-time gets you 4 hours of game time.
Jev and the fast-follow models seemed to be useful in this direction.
Jev for fast actions + LLMs for more strategic planning?