I answered this in my reply to pgcsmd, but additionally: I don't have kids but my taxes supplement education. I don't drive, but my taxes supplement roadworks. Likewise, my taxes also supplement justice.
Now the US prison system has become a corrupt business - and that's a separate and awful issue. But the fundamental ethical basis for punishment stands: you steal money, you pay it back - you deal emotional trauma, you pay it back.