I'm skeptical the public sector would do better. The U.S. defense and intelligence institutions are public and (from my perspective) seem to be quite eager to engage in conflicts, same as a private institution with financial incentives to do so might.
The real culprit here is prosecutors that have very little interest in actual justice, but instead have a strong desire to win cases and secure harsh punishments. Private prisons don't need to lobby prosecutors and legislators to do these things. Prosecutors and law makers are all too eager to be "tough on crime" all by themselves.