The issue here is that a not too powerful local device could do that without recording everything you say in the cloud and keeping it forever with a label with your name on it.
I don't disagree on that point at all. Just commenting on how even if these devices aren't particularly smart, they still provide useful functionality.