Chess, and perhaps Go, might be outliers here, in that both are designed to exceed the human mind's possible ability.
But for everything else, I agree with you. I'm able to learn new skills considerably faster now than in my twenties. Part of that is practice learning, and part of that is having a lot of things to relate any new concept to.