It wasn't the "can afford them" that changed my mind. I genuinely used to think "being a landlord is normal" until I had time to sit with it.
While I sat with it, I did become more financially comfortable, but it wasn't the money that changed my mind.
And yes, across all income levels, I do believe making a profit from housing others is immoral. But like, as long as we have major corporate landlords I'm not going to spend much thought on mom and pop landlords. If you are renting a spare room out it's like, "hey, I don't agree with what you are doing, but I understand it."