Wrong in what sense? You owe them the courtesy of explaining your decision, but that's about it. It's your life, it's just business for them.