Unfortunately I already have an apartment to pay for, and no guarantee that if I left my job for 3-6 months I'd be able to get it back. Definitely worth thinking about though!
The Vikings used to burn their boats so that they had to succeed!
Reads like you're already too comfortable where you are to take the plunge. If you can't work on your project part-time, then why not do some other part-time work, save the money and then Do It!.