This is only true to a point. When I was cycling 20 miles 5x per week, I literally couldn't eat enough to avoid losing weight. (This was not a problem, I've never been thin.)
In the past I've toned my training down due to exhaustion, not from the physical output but from having to constantly be shoving calories down my throat.