I think that depends... open floorplans already have plenty of ambient noise usually. Chatter, people on phones and web calls. If the voice input picked up in a small range and people got in the habit of kinda semi-whispering their occasional commands... I doubt it'd be a massive difference.

But I'm assuming lots of things, I can also envision your scenario playing out to great annoyance.