What I did was start small and learn the skills and grow my income from my "hobby bUsiness" until it became equal income to my day job.
At that stage you will need to decide which way you're going to go. Stay safe or go with your passion.
Also read up on all the other parts of running a business such as accounting etc, there are lots of good links on HN about this kind of stuff, It's invaluable.