I think this is a personal issue that will improve through discussion with your wife and a counselor or therapist. I doubt that it'll improve much through discussion on HN.
This is more of a "does anyone else get this way?" because I'm having a hard time relating with the real world in this issue.
I don't - moving generally fills me with excitement, even when it was to a new country. But I have friends that react in such a way, so it definitely isn't just you. I'd say the other reply here is correct, however. I think the best course of action is to talk to a professional - therapist, psychiatrist or medical doctor. If you can get rid of the anxiety that leads to a near-panic attack, it'll make the decision making and the stress involved in such a decision easier to navigate and talk through.