And so are music departments.
Which I think is part of the point here. I firmly believe that playing right tackle can teach you just as much as playing the oboe, yet intellectuals tend to look down on former and praise the latter. Organized sports are not only a hobby and social gathering, but they can also serve as part of a greater learning and education experience. There is a reason why a few of the Ivy League schools rank near the top of all universities when it comes to the number of varsity athletes.
>that college-level sports is hugely abusive and exploitative to the players which actually play it.
You need to be specific here. Big revenue college sports (basically only Div I basketball and Div I-A football) are definitely exploitative, but most college athletes participate in sports that generate little revenue and it would be hard to argue they are being exploited.