For more advanced workflows, you can use Huginn for Ruby:

https://github.com/cantino/huginn

or Node-RED for JavaScript (this one is backed by IBM and has a neat drag and drop UI)

http://nodered.org

I think once the voice processing is done, the hard part is getting it to actually do something useful.