In plenty of jurisdictions people are entitled precisely to that. Here in Germany the entire basis for punishment is a right to full reintegration after you have been punished. A just community punishes once, not five hundred times over and that goes both for the people and the state (which are the same thing in a democracy, the latter punishes on behalf of the former). If you come out of prison and you've paid back your debt only to be ostracized and arbitrarily pursued by a witch hunting public that's not a just society, it's a mob. It's worth repeating, if someone goes to prison you're putting them there, it's "we the people vs X". "The state" is exercising power on your behalf.
That's the basis of a working social contract. You harm the community, you pay, but afterwards we have an actual duty to resocialize you, otherwise we just acted in arbitrary and disproportionate fashion. Criminals have rights in a civilized society, including to privacy and not be discriminated against, by say employers.