My family has been in the rental business for more than 30 years. I have 2 of my own. We never had any issues like the op mentions. A couple late payments and 2 evictions from lack of payment and that is it since I remember (I only started helping around 15 years ago, can't say what happened before).
Just really choose your tenants carefully. Better to have someone you know will take care of the house and get 400 a month then someone that can pay 500 but shows a lot of warning signs they will trash it. And if you are even remotely handy, a lot of the small fixes can be done by yourself in a matter of hours.