I rent, by choice. My landlord takes the risk of owning the property, and I pay a premium for that. Something breaks, I make a call and it's his responsibility. Just because some landlords are bad people doesn't mean landlords are bad people in general. I appreciate the benefits I get from renting (and, to be fair, from having a good landlord).
By your logic, owning a small company with some employees is passive income and "bad", because you have people doing work for you. Some small company owners are bad people but that doesn't mean all of them are (and, in fact, we tend to consider them fondly from what I've seen).