I think you underestimate the link between physical and mental health. A fit body gives you a different baseline confidence. People react more positive to you. All social things considered, deep down we're all apes, so risk averse behavior might have something to do with a subliminal knowledge that you won't be able to defend yourself physically. Also exercise promotes neurogenesis which is basically the foundation to change your mind and overcome anxiety, depression, addiction...