Someone doing harm to you doesn't automatically mean you wish harm to them. Not that I necessarily take what Garry says at face value but it's definitely possible to unironically take this viewpoint.
That may not automatically mean you wish them harm in return, but I believe it would be very uncommon to not.