I don't care if others need me, and here's why.
With AI-driven speech recognition, I have far more agency than I did without, period. I can write, I can code, I can communicate with various entities, people, government organizations, corporations, chatbots. I can fill in online forms instead of leaving a bunch of spastic scrawls that generate more questions. I can use it to drive OpenSCAD and 3d print something.
And here's why I start out by saying I don't care if others need me.
I think I'm congenitally incapable of not building/designing/exploring things. If we had an AI-dominated future and we were all on UBI, I'd still find myself saying “hmmm, I wonder” and going down a rat hole to see what I can find. I'm doing it for myself. My curiosity and satisfaction in bringing something to life, even if it's only a variation on what somebody else did.
Rephrasing something I said in a comment somewhere that I would spend time gardening, bird watching, and building a closer relationship with my partner and my pets. I would have no want of things to do or explore.
To your last point, we don't need to understand how something works for it to be useful. Doctors don't understand why treatments work and why they fail. If doctors waited, if treatments waited until they understood how and why it worked, I'd probably be dead. But because they don't, I now have a VP shunt in my head (aka, medical-grade juice-box straw), and my life has drastically improved. Toddlers are something parents don't understand—the how or why they do what they do—but they keep having them anyway.
WTF moments are an emergent property of toddlers, goats, border collies, working dogs, hunting dogs, and AI agents. And like with a toddler, we need to deal with it like we're the adults in the room.
Too many people in my life have died of cancer, and the agony and pain as their body hollows out to a waxen shell is something I'll probably never forget. If I had a choice between understanding how AI works and a cancer cure, I would choose the cancer cure, hands down.
One thing we do need to do is slow down the development or the build-out of AI data centers and put a resource constraint on the model companies, forcing them to get better with the same resources. Sort of an economic “you can't have dessert until you've eaten your vegetables” moment.
I really got to sit down and write that blog post on why agents are like toddlers and that toddlers should have figurative machine guns.