What about the argument that they are provided "free to them" food, shelter and clothing? And therefore them working for very small amounts of money, is really them paying for those things.
Change laws and punishments so that fewer crimes result in jail time or removal from the workforce, for example. Especially for non-violent crimes. Improve conditions for poor folks, the mentally ill, and so on.