Doesn't necessarily have to be left up to the whims of one person though.
By the time a pardon comes the persons life is usually already in deep distress, and whatever they were working on is likely already over. I don't see why it's such a tragedy to let some people get pardoned who maybe don't deserve it.