It's worth noting that chess grandmasters can burn up to 6000 calories per day while competing in tournaments. It's an absolutely exhausting endeavor, and I imagine sheer endurance can play a huge role.
So yes, performance does fall off with age, though not as intensely as something like hockey.