Total tuition loans outstanding is around $1.5T. Total US Education Dept annual budget, 70B. Median length to pay off student loans is around 20 years. 30% of people graduate with no debt, and of the remaining, median debt is around $30k, the cost of a decent car, and a fraction of what the same people will pay for a house.
Adding the entire Ed budget for the past 20 years is no where near the amount of loans outstanding. And in fact they lend only a fraction of their budget to student tuition.
Thus your claim that the US Ed dept is paying at the end of the day is mathematically impossible. The debt is from private lenders, who do have incentive to ensure borrowers pay back.