Other companies have done this (see Qwen Coder). It doesn't scale past a few disciplines like math and code though, and using mixtures of experts give you most of the same benefits.
It's just a fancy name for sparse evaluation of the total network to save compute and memory bandwidth.