Sure if it's worth breaching anonymity for. Last time this happened I recommended about 5 things one of which was mine. I guess it's the more borderline cases I lose sleep over.
I think there is some aspect here of just finding reasons to dislike the reviewer (though I've certainly had reviewers where those reasons were pretty easy to find).