Is that phrase used commonly? And would it normally be used in private, or is it more socially acceptable to say these things?
Where I live, wishing anything bad happens to your neighbour or even a stranger would be plainly understood to be unkind, unreasonable, and generally mean to some degree (depending on the severity of what you wished on the person).