The counter example is that sports are linked (hitstorically) with (very) successful Academic Institutions. The notion that "they have no place there" is historically way off the mark.
[Edit: Examples]
[1] In 1815, Eton College documented its football [soccer] rules, the first football code to be written down anywhere in the world.
[2] In 1845, the first football [Rugby?] laws were written by Rugby School pupils
[3] Some historians have argued that the primary influence on Australian rules football was rugby football and other games originating in English public schools
Springfield College [MA, USA] is ... famous as the site where the sport of basketball was invented: instructor and graduate student James Naismith invented the game in 1891
{etc}
The real issue is their impact on high school culture.
Again, this is at best culturally specific and self-referential. At best this is a political position: more time and attention should be allocated to {X} group not {Y} group. It also hinges on the false notion that (political) "merit" is correlated with "academic" merit. This is also a an obvious falsehood, and frankly the purpose of sport in schools is to teach the opposite. To use a stratup analogy: ideas are a dime a dozen. Its execution that counts. So, character is something that matters.
And rightly or wrongly "character" and "teamwork" are subjects not developed/selected for in the classroom.