You can also throw together a cheap software KVM switch[0] using an ESP32 or similar.

[0] https://euer.krebsco.de/a-software-kvm-switch.html