This is where you might be misunderstanding. Downtime shouldn't be to engage in more stressful mental activity. Think about it. Go to the gym. Study for a big exam. Are you really engaged on the goals of a gym? Are you really engaged in getting a good grade on an exam? If you are, you are finite and I highly suspect that the high performers aren't going to try and add more stress on their lives (political or anything else). I'm suggesting they aren't sweating enough at the gym. I'm suggesting they aren't working hard enough. I'm not suggesting that they're a slave. I'm not suggesting they are a wage slave.
I'm suggesting they are more likely to be working in a half-assed way and don't have a 'buy-in' to the company's objectives. Which tends to be true based on numerous business management studies (since at least the 1970s that I've read).
Hard workers want enjoyable leisure. Not pissing off a Karen. Or dealing with a Greg. This is a toxic mindset that doesn't make any sense.
P.S. There is also another variable. That some people are closed minded but, imho, that can be overcome with good soft skills of a good manager/vision/buy-in.