I have yet to run into this problem, do you have any examples? I don’t have any exotic hardware outside of the ThinkPad X220 dock which nowadays only works with Linux.
I suspect power management is also poor.
On which version? I'm running Server 2016 (Datacenter) with an Intel iGPU, and I don't recall having to do anything special to get it working.
Another issue I've run into was Server 2016 not having trackpad drivers for a Dell laptop's I2C bus/trackpad.