what are the guardrails?
if there are many of them (e.g. unit tests), who generates those guardrails and who verifies their correctness?
if they are a few, then how can they cover vast product capability surface?
if there are many of them (e.g. unit tests), who generates those guardrails and who verifies their correctness?
if they are a few, then how can they cover vast product capability surface?
In my own works, I've been using a home grown harness called DevArch for about 10 months.
Visit https://genai.cornelson.net/ if you want a detailed rundown of my experiences.
Guard-rails are totally ineffective
If you're just knee-jerk anti-AI, then you probably need to sit down because some of us are taking serious evidence-based paths with GenAI.
If you have real data on guardrail ineffectiveness, that would be excellent material to share.
This is why those of us that follow DDD principles are successful. We know how to manage complexity whether we’re doing it manually or by using GenAI.
There are plenty of non AI security analysis tools we still use and add review gates for security gaps.
There is a huge misunderstanding about understanding the code. It implies knowledge of the classes, interfaces, and even internal logic.
If you design a modular system and generate code under strict rules, no one needs to know any of those things. We only need to understand the design and the results.
If we miss things, iteration is cheap.
Doubt!
Sounds like utter bull-crap!
But I’m lying and nothing I say could possibly be true.
Except it is and I have receipts.
"Strict rules" does so much heavy-lifting in what you said that it basically decides whether it applies to any reasonable complex system or is pointless and just worked on your constrained system and wouldn't translate to much else that isn't like directly related or analogous.