I adopted the opposite approach because I'm a control freak and can't stand working on other peoples' projects. I kept my day job as a programmer outside the game sector, and indie it up in my spare time.
Don't feel bad if you want to bail. You're most definitely not alone in that respect. The way to spin your experience to potential employers is to emphasize how demanding game development is: tight scheduling, zero percent bug tolerance, rapidly changing standards, performance is always an issue, etc.