It is, in fact, the unions' fault. The prison unions and police unions are huge proponents of the drug war, longer sentences, etc. It isn't just there fault, of course, America's general Puritan streak helps, but the public unions have really capitalized on that.
> other countries with more powerful unions don't jail themselves like this.
What happens in other countries isn't a good model for the U.S. Sub-segments of the population don't viscerally hate each other in Frankfurt or London the way they do in L.A. or Detroit. It will be interesting to see what happens to the internal social cohesion European countries have enjoyed post-WWII as middle eastern immigration continues to rise. A few more muslim youths rioting in Paris and I think you'd be surprised by what kind of police escalation Parisians will be willing to put up with...