Sure. Point being it’s all gathering. No difference when you gather berries or other peoples stuff against their will.
If this guy got shot stealing from people, we wouldn't just call it killing; because we have a philosophical framework about justice and retribution. If you were consistent, you'd have to be okay that this guy would be treated like a fox who raids a henhouse; up to the personal whims of the aggrieved.
From the hermits point of view, outside of the society with its philosophical framework, it is just gathering.
Society may call this theft. I may also jell at the crow stealing my unwatched food "you thief, give me back my food!". That is from my point of view, not the crows'.
To society the hermit still is human and we have morals and ethics that shall prevent us treating him as just a raiding wild animal / fox.