This is a terrible idea. NLP, with or without LLMs, isn't remotely close to being able to interpret commands in someone's house. And who would want a non-deterministic voice assistant anyway?
Imagine you say, "Alexa, turn up the air conditioning," and Alexa interprets this to mean you want to increase the temperature. There are uncountable and unforeseeable failure modes.
Note that this happens even when talking to humans with near-perfect NLP/brains.
The major flaw with voice assistants in general is that they only make sense if they have a pretty narrow and pre-defined universe of accepted commands, which is incredibly confusing to someone who mistakes them for actual NLP.
It's just a really, really bad UI. I use mine all the time, but only to set timers and turn lights on or off.
- why ChatGPT's style of "convincing bullshit" is a bad fit for a user interface like Alexa
- failure modes of NLP in UIs
- why NLP still won't save Alexa if it gets to a human level of accuracy because humans aren't accurate enough
If you have any actual knowledge or argument other than, "You're ignorant, [technology that doesn't exist] is going to fix Alexa," then let's hear it.
My knowledge is that I know how these systems work, and why its so hard to get them to work properly.
It doesn't matter if you're Amazon's ML expert or the world's best surgeon or a barista if all you do is make an unsubstantiated statement and give your credentials.
So here's my process with Google Asisstant:
- guess what it will understand through trial and error
- use that command pattern, like "set [something] to [level]%", for a few months
- try it again one day, and suddenly it doesn't work
It makes you scared to trust it in almost any situation.
"up" and "off" sound similar too, and I've had assistants confuse them often.
Voice control is a miserable interface, and there are few applications which I would endeavor to use it. Time, weather, math, and maybe a trivial fact queried from Wikipedia.
I found myself shouting at these assistants while they try to interpret what I say mid sentence.
The novelty wore off very quickly. But voice seems like a very powerful interface if you can solve privacy and usability issues. Seems like we haven’t tried very hard at this yet.
In comparison Google and Apple are competitive in so much more (in particular calendaring, contacts, music/videos).
I think Amazon missed the boat in not coming with an open standard and get cosier with independant makers like Sonos or Ikea etc. Basically they could have pulled an android for the voice assistant ecosystem, but preferred to try to build another walled garden.