I don't think there is anyone who actually thinks of these things in terms of "regardless of the harm it causes others". Ok, this being the internet, we can probably find one, but I don't think there's any significant portion of the population. That position is basically a strawman.
I do think, however, that there's people who draw the lines in very different places, or put different weight on different categories of harm.
As an example, physical or financial harm are very easy to verify. There's not a lot of debate about if they qualify. Mental or emotional harm, on the other hand, is very hard to verify. This presents a significant problem for anyone who is worried about the system being abused. These groups will draw lines at very different places around any claim of harm within those categories.
The end result is that you'll end up with one group being labeled as grifters who want to fleece the system, and the other as being completely insensitive to human suffering (sound familiar?)
That's not even to get into the debate of what constitutes harm. For example, is not helping someone harming them? Is ceasing help once you've started helping someone harming them? These are too big of questions for the post, but I imagine you get the idea.