These dudes have been doing something similar: http://voicecentral.riverturn.com/