Is it possible to swap GPU assignments from the host OS to a guest OS and back, or does it require some motherboard-level/boot-time settings that make that difficult?
Never tried, some people had success with NVidia GPUs. However, if you are willing to put your host in sleep and wake it up, then it should be much easier. Sleep usually resets the GPU and lets host drivers grab it.