Things aren't only bad if they're illegal. There's plenty of bad things one can do that are perfectly legal, and plenty of good things one can do that are totally illegal.
If you prevent your grandparent from getting scammed, you've caused financial damages to the scammer.