A story I heard from a Tesla employee was that it’s impossible to hire because musk is mercurial and every time a hire makes it through the pipeline a hiring freeze cancels all offers. Another story that employees were told to avoid his desk because he randomly fires people. Another that he regularly cancels bonuses because he’s feeling petulant. I heard another story that he threw up Nazi salutes on an internationally televised event. No wait, that one I watched happen.
After a while smart people will simply decline to work for him no matter the compensation. Not everyone, but enough to start to matter.