Not really. I mean, if Google chose to let them than sure. Otherwise it wouldn't be that hard to have Chrome (which is based on an open source project but is not itself open source) send an encrypted key in each packet ensuring it came from a Chrome browser.
That said both Microsoft and Apple have voice recognition engines built into their client OS which seems like a much better option latency wise.