Haven't tried it yet, but I hear Pocketsphinx has a keyword spotting mode.

https://github.com/cmusphinx/pocketsphinx