Monoprice make a HDMI switch that does a lot of this. No metadata for game mode, etc. as far as I know but I have:
TV
Apple TV on earc connection (HomePods for sound)
Blackbird switch with all other devices.
It can automatically switch between everything, but also has an IR remote for selecting an input.