I don't think SCOTUS in its entire history has ever directly ordered anyone jailed, only upheld lower court rulings jailing someone or overturning opinions that concluded someone shouldn't be jailed. So at most that's recourse within the judicial system failing, not lack of recourse; obviously, pardon power can "fail" as recourse too, if anything, not providing recourse to injustice is the normal operation of pardon power.
If my choices were status quo and status-quo-except-pardon-power-is-abolished, I would probably prefer the status quo, because law enforcement overreach is currently a bigger problem than abuse of pardon power. But you made a much stronger statement: "There's no choice in a democracy but to have something like the pardon power." I disagree with that, I could easily imagine a much more just and fair democratic system where all recourse to judicial overreach still involved a decision by a judge at some point.