You pay for the best jail you can afford. If you are found innocent, your accuser/prosecutor has to reimburse your costs. If you are found guilty, you have to pay restitution to your victims (or their still-living representatives), and the justice service provider handling your case will take whatever measures may be appropriate to protect their subscribers from you after your release. If you can't immediately make restitution, there may be a supervised work program around that will help you finance your jail boarding and court judgments. Or maybe the judge will work out a deal to reduce your weregeld bill, perhaps in exchange for something like submitting to a specific torture, or having a warning tattooed across your forehead.
If you're a really hard case, you just get named outlaw, and someone kills you for the bounty.
For most people, instead of paying taxes to a county, you would pay a subscription fee to a company that provides all-in-one security, dispute resolution, arbitration, rehabilitation, and property and casualty insurance. You might pay $99/month to a reseller agent of Brinks Allstate, and your neighbor might pay $119/month directly to Alfa Pinkertons through their website. If your kid's bike gets stolen, the cop-adjuster comes by to take your report, helps you file your claim, and determines whether it would be cost effective to investigate and prosecute. If they do, and it turns out your neighbor's cousin was operating a bike theft ring out of their garage, the Alfa Pinkertons arrest him, put him in their jail, and provide him with defense counsel. Brinks Allstate and Alfa Pinkerton have a pre-existing extradition agreement in place, engage Wopner-Brown-Scheindlin as their arbitration subcontractor, who in turn sub-subcontracts some jurors from YourPeers. (You might also need to have a separate justice provider through your workplace.)
After the neighbor is found guilty, he has to pay back the cost of reimbursing the bike owners. Perhaps a few of them are willing to buy their stolen bikes back with [a portion of] their insurance money. Until his checks clear, he stays in the Alfa Pinkerton jail's sweatshop, working off that debt at $X/hour. After he's out, he goes right back to being that creepy guy living above your neighbor's garage, and his credit score goes back up with that "RESTITUTION PAID IN FULL" line on his report.
As bad as this all sounds, our actual, real-life criminal control system is in some ways worse.