it actually very good setup for some cases and I've worked in similar mode for a while using by usb switch device with single button - but I found that is little bit too painful because in may cases to move something from one machine to another is required unexpected 'extra' step which in lot of cases breaking usual productivity flow in worst moment.