That's not how I interpreted it, but I could see how that could have been what he meant.
In that case, I do think staring can, in certain contexts, be considered harassment. I would hope that it could be solved by a conversation ala "please stop staring at me".