Is that a valid argument though? Of course things should be judged on a case by case basis, and not on dogmatic one size fits all rules.
Even courts take context into account for the same action (e.g. whether a murder was in cold blood or premeditated, whether someone stole because they were hungry or just greedy, etc).
And, yes, "there is a time and place for stealing someone’s wallet", as well.