I spent many evening hours working, and did not foster the relationship. I stayed up late at night, she was going to bed alone. Even good relationships need constant work.
Secondly, I think working for myself somewhat transitioned me from "boy to man" so to speak, not in a good way. I became less inherently trusting of other people, and sometimes the stress wore on me and I became distant.