Microsoft employee here. MKL libraries and headers will show up in CNTK soon. We are working with Intel on this.
Compare and contrast with ~1 TFLOP ~$7,000 Xeon CPUs.
I have brought this up with multiple Intel engineers and for the most part they nod and agree. Then they tell me that there's no way Intel would ever start doing things like NVIDIA does here. And then I nod and tell them why I continue to bet on NVIDIA for the immediate future, sigh...