This is a common misconception.
Only 20% of state and federal prisoners (those serving more than a one year sentence) have drug crimes as their most serious conviction.
80% of prisoners are serving time for violent (47.7%), property (17.1%), or public order crimes (13.8%) that no one would argue are victimless.
While some of the other crime is related to drugs, the point is that 80% of the prisoners in the US have grievously victimized our fellow citizens and residents and are not innocent "[people removed] from society in order to address the 'drug problem'" as the parent comment stated.
Source: http://felonvoting.procon.org/view.resource.php?resourceID=0...