Couldn’t possibly be that serving data to scrapers isn’t a core function for a university or that they can’t pay big tech salaries to draw sysadmins and engineers that know how to handle large scale deployments
First function is archival and preservation, second is access for university students and researchers. It’s not Anna’s archive or TIA