It really depends on the type of agent and problem but your path resonates as a way to slowly build more complexity as you start understanding the uncertain space. I've written about it in my blog with the intent of helping non tech users [1] and also created a site with cookbooks and eval tool comparisons [2].
I've successfully managed to get non technical users into the terminal, even before Agent Skills were a thing. It's absolutely doable.
If any of what I share helps or you have any feedback/questions let me know. I'm quite interested to see if the framing works.
- [1] https://alexhans.github.io/posts/series/evals/building-agent...
- [2] https://ai-evals.io/