IIRC, one of his examples at the beginning of Outliers was a group of Canadian boys who excelled at hockey - in part because they were among the oldest in their cohort, and thus had more opportunity for practice and growth relative to their peers. From that example at least, it wasn't clear to me that he meant to exclude athletics from his thesis, anymore than it's clear to me that sports aren't a complex task. Have you tried to hit a baseball lately? Or hit a three-point jump shot? They actually are complex tasks.