That is, if I want to change the keyboard layout for GameX, I must start GameX, minimize it, change keyboard layout (and hope that it applied it to GameX - often it does not), maximize GameX.
Alternatively, I have to remove Colemak as a keyboard layout and set qwerty as the only layout. This is even more effort.
Basically, in windows, changing keyboard layout to play games is not a viable solution. Believe me, I've tried. I don't play those games anymore...
And switching to a layout you don't normally use absolutely sucks for e.g. in-game chat.
It's not the right solution, it's a sad workaround.
Things get harder still if you need to rebind keys because of the physical arrangement of the keys on your keyboard. In this case, you might have to create a custom layout for each game.. screw that.
Windows does this. Its horrible. It also doesn't remember what window has what layout between sessions, so you have to manually set the layout each time. If the game is a fullscreen game its even more effort because if you alt-tab out, it is no longer the focused window (and therefore changing the layout does NOT apply to the game.. frustrating).