You are committing the same fallacy that you are prescribing to others. If rehabilitation is taken seriously and provided the required resources, recidivism is a „statistical minority“.
As with many social issues, the US happens to be very bad at this currently, with recidivism rates double those of the UK, for example. UK prisons are notoriously bad by European standards and they have plenty of violent crime. But criminals are in the vast majority of cases not criminal by nature. Most people want to live a socially conforming life, given half a chance.