I agree with everything you said except for this. The idea that many/most/all prisoners are violent or sociopathic is a myth propagated by those who stand to benefit from the prison industrial complex. Prisoners are human and prisons are inhumane. For another take, here's the IWW IWOC[0]:
> Incarcerated people are legally slaves as per the 13th Amendment which abolished "slavery and involuntary servitude, except as punishment for a crime". We are legally slaves. If you've been to prison you'd know we are treated like slaves. Billions are made annually off our backs. Outrageously priced or grossly inadequate privatized 'services' like health care, food, phone calls, assault our humanity - they feed us like animals, suck our families dry, and when sick leave us to die. The government spends as much as an elite college tuition per person to keep each of us incarcerated, but this money does not develop us as human beings, reduce crime or make our communities safer.
To finance it, tax the rich, dismantle 4/5ths of the US military and stop fueling wars overseas.
But that's called socialism and is (unlike actual treason) treated like it would be high treason by the US political parties; mostly because they are all in the pockets of wealthy donors who would not like this new regime.
To have no homeless, you have to have both resourcing for housing/medical, but also be willing to use force to compel those unwilling to get treatment/be housed where they have little choice. That’s a very tough leap to make.
The choice part never made sense to me - why would anyone want to live like that? But, as a society we value free will and therefore must respect the choices we do not agree with.
Most folks don't actually want to live like that, but some really do want to shun society. You can offer folks things like primitive cabins to help them shun society. Substance abuse, mental illness, and job loss are real problema with real solutions. Heck, if you can't solve someone's substance abuse or alcoholism, you can at least make sure they have shelter and food available to keep them safe even if they won't pay for such things. For a single person, it doesn't have to be luxurious: A dorm setup with private bathrooms and shared kitchen can work out.