> switch time is long and the monitor doesn't reliably wake up

In my personal experience, obtuse monitor's firmware is often to blame.

Using a switch with one extra input port, where all data pins are connected to ground (via series resistors), and switching to that port for a brief moment, before switching again to the real intended input, usually helps some.