Did you get your Testosterone checked? There are studies showing men lower T levels when babies are born, if you were already low it could be a issue.