Only if you have the interest and aptitude to dig in. Compare this with OP's story about trying to learn music instruments at an early age, and his brother. Like others have mentioned, it's a combination of things - you have to have the innate interest (or, if you're unlucky, really overbearing parents who force you to learn it, like Tiger Woods IIRC).