so how about things like this: I am married but I meet another woman who I cannot help falling love with. Shall I continue hang out with her, or stop seeing her(which I will probably regret)
That said, I'm not sure why a person would live the rest of their life with someone they don't love out of some sort of imagined duty. You certainly aren't doing yourself any favours, and odds are you are making your wife miserable too.
If you have truly found someone that you "cannot help falling in love with", then why wouldn't you be with her?
Imagine he loves his wife but is also falling in love with another ... Only he is afraid to pursue.
Should he pursue or not? If not, why not? Is his sky-diving hobby any less "destructive" than his philandering?
Ah ... like the blind Colonel once quipped: "when in doubt, fuck."