You can run X11 in a separate terminal?

Anyway, doing network-resilient X11 is a harder problem than just ttys.