I've spent a good bit of time trying to get CMUSphinx to transcribe audio with any amount of reasonable accuracy. I never was very successful. Resorted to using paid third party APIs.
I really wish there were better options out there. Hopefully Simon will help improve the landscape. The automatic contributions to Voxforge should help.