Banks exist to make our life better when we need extra spending cash. If we ban lending to the poor than it will be one more thing that only the rich will have.
I agree that the lending rates are insanely high, but that's largely because of defaults. The rates for secured goods (car, house) are insanely low, even when the defaults are taken into account. Car loans from credit unions are below 2% because they're secured.
The real problem is that the easiest way to cure defaults is to start saying "No" more often. But no one likes to be told "no" and that's unpopular too.
And, yes, the rates do go up for people with a bad credit history. You can call them "the other half" but the simplest way for you to demonstrate your devotion to helping them is to quit writing comments and go lend your retirement savings to them. You seem to imply the banks are just overcharging out of some evil motive. Now is your chance to prove how wrong they are by cashing out your trust fund (you sound like a trustafarian) and loaning it out at "fair" rates.
Just remember that every default by "the other half" destroys hard earned capital of retirees. The low rates really hurt the older savers. They're part of the "other half" too.