There are lots of cheap things you can do in those towns - and you will do only those things for entertainment. You will probably be known as the guy who makes desert art because that is all you can do.
I wouldn't want to live that life, and I don't think most others reading this would either. However you could do it. Most of us would enjoy that life for a week or two every year but then want to get back to modern life. To each their own - if you want it go for it.
$200K could net you about $10,000 a year if you put it in super high rate tax free muni bonds.
Even with the hermit lifestyle and no taxes, you'd still have to pay for maintenance, property tax, food, and clothing once in a while. Remember, we're talking retirement, so you don't have any other income.
I don't think you could pull that off. Substance farming is work, not retirement. And like you said, without internet, you'd pretty much be relegated to desert paining.