A good start to reform would be to stop making crime a profit center for corporations that provide prison and rehab services. Their interests are the lowest quality at the highest price, and they will lobby politicians towards that end even if it's not in the best interests of turning a criminal back into a productive member of society.
The government may tend to lack efficiency, but at least its lack of profit motive wouldn't completely taint the whole system.