I don't know if there's a connection or it was just the people I came across, but another thing that bothered me was that people who subscribed to an innate talent model tended to be useless at evaluating skills. They'd have no idea what to ask, what to expect as an answer, and they'd have no BS detector.
I think a more healthy approach to talent is comparative advantage. You already have a team, and you want to improve it. Even a person who is not better than anyone at any of the relevant skills can improve a team, because it's opportunity cost that matters. The canonical example of this is the CEO who is better at strategy and grammar than his secretary, it still makes sense to have a secretary write the letters.
The reason sports talent is different from most other talent is that you have a limited number of players on the field. It's then a straight up production-over-replacement calculation, whereas most teams in business don't have that constraint.
It also gives you a floor. If I'm writing a c++ system and the junior on the team eats up time being hand-held, that eats into that opportunity cost savings. I suspect this is actually what people mean with "talent" when hiring, they want someone who doesn't necessarily have all the answers, but will behave in a way that doesn't impede the existing producers.