Nobody doubts that atheletes often had to train hard.
But you actually posted the counterargument by yourself:
> Sure, college is about academics
Exactly: college is about academics and not sports, so athlets should only get a "VIP lane" for academic achievement/potential and not for athletic achievement/potential.