On a personal note an acquaintance of mine served several years for a sentence for which he was later fully exonerated. It was a thoroughly awful travesty of justice. He also underwent appalling abuses as the alleged crime for which he was convicted was sexual in nature. No system is perfect and there will probably always be mistakes made, so lets at least make sure the consequences of such mistakes don't burden our consciences any more than they need to.
It's not Vengeance if it's Justice.
What we could try to do is focus much harder on making sure that actual justice is carried out, not arbitrary things or mistakes.
Enormous resources are expended attempting to ensure fair trials and the system still fails regularly and often. Fixing one part of the system shouldn't dependent on fixing an unrelated part, we should I think try to do both.
Would you be fine with that?
They still have to be alone. Justice is still being served. No sane person would want that life.
You still achieve what you want. Unless you want to be cruel for the sake of it.