If the money from the loan is actually paid out to you, then it’s not too surprising that you need to give it back.
Consider the case where I have a small checking account in which I deposit my child's allowance, the child discovers that this account has $10,000 in it for some reason, and, like a child, goes on a spending spree. Is my child responsible for exercising some measure of restraint with this money? They are, in the eyes of the bank, authorized to access this money for their own use, but suddenly you think that I am obligated to return thousands of dollars that my child spent on minecraft skins or something because the lender wants to lower the friction for loan applications?
The lender should be generally SOL.