I very much agree with you. As much as I appreciate the idea of everyone going to college, I think the idea of making loans easy for anyone to go to college has been a huge disservice to a lot of people. Students don't view the money as "real", they simply view it as a free pass to go to the "best" (i.e. most expensive) college. Universities know that students can get loans to cover their costs, so they raise the costs as fast as they can. Also deserving some blame are parents who don't spend enough time really working with their kids to remind them that a $50k/yr loan, WITH INTEREST, is going to be insanely hard to pay back.
But ultimately universities are going to raise tuition as high as they can because they know that students can get loans very, very easily.