I have the opposite opinion. I don't see the point of a simple window with a microphone image, or something like the Siri bubble, being any better.

Then use llama.cpp or whatever. No need to be sour over more options & innovation