That's a completely different argument. If you don't want your notes online, you don't use an online note-taking app whether it's with AI or not.
"It's AI" is the new "someone else does it", just like "the cloud" was yesteryear's.
PS In reference to running AI locally: for my own (non-online) app (Calcish) I specifically waited to introduce AI until local modals become usable, as I didn't want to just add APIs and be done with it — it happened and now the app provides a choice.
Local AI in browsers is something that's Chrome working on (https://news.ycombinator.com/item?id=40834600) — I think it can already be adapted for Grug Notes use cases.