Ride 4000 miles a year and see if you don't lose fat.
I might lose 5 pounds a season in a typical year, despite burning close to a thousand calories a day. But my bet is much of the reason for that is offset eating.
Of course, I agree wholeheartedly that I'm healthier at the end of a cycling season than before. You just might not realize it by looking at my physical proportions.