Unless we're talking a high density urban environment, there aren't generally too many candidates for retaliation - especially for angry folks not too concerned with getting it wrong.
Yes I'm sure complaining to your HOA is WAYYY safer.
I can only hope your HOA takes your living space over the paint on your door some day.