There's no "reliving" of the burden. It is transferred to others, including those who already paid their student loans once, and those who never went to college in the first place. That is, all taxpayers and holders of government debt.
If the money was clawed back from universities, that would be fine, since they were at the receiving end of the racket.