Certain kinds of crime: absolutely. Sex offender registries exist explicitly for this purpose, for society to permanently treat you differently because of what you did.
They don't exist in most societies though. Just because your society happens to have such public registries, doesn't make it some objective truth that such registries are a good idea.