2,593 karma · joined March 27, 2013
I even found it was capable of stepping back from code implementation and bug hunting to “hang on, it’s not the algorithm that is incorrectly implemented, it is the wrong algorithm for the goal.” GPT Sol (5.6,6 and 6.1) just kept hammering in the problem.
GPT stays too much in text imho.
I’m doubting the quality of the model, even comparing with luna 5.6, it is giving such bracingly wrong answers. It claims other tools have changed the code when pressed why it made a mistake. That code or tool didn’t come close to working on the project. It is scary.
People who made something their professional life goal to become good at something have their work marked as AI, and even worse, like effortless or slop. Just because a tool has been trained to match that good style or type of output. A good system (tailwind) is not used directly anymore because the LLMs take all the wind of their sails by embedding the knowledge in the model.
This happens all without any form of attribution or compensation.
It’s not nice. But I don’t know what to do about it.
So really it is not saying much at all.
I use it to find reasoning gaps, add examples, add citations etc. The LLM/Agent can find them quicker than I.
When I ask for an explanation it adds the right amount of detail. Of course, some of the material is new to me so subtle errors are hard to spot. But at least I’ve caught Terra and Sol on inconsistent messaging.
Also I’ve found 3.8 flash to circle back to root issues even at the conceptual level like problem fit and conceptual solution direction or architecture when I wasn’t achieving my goals. It flat out said I was attempting to use the wrong tool. Whereas Sol and Astra kept rabbit holing and looking for tiny implementation errors. Even after prompting them specifically to look at it broader.
Then every time it tries to do so ask it why it didn’t use one of the ones from the list. Update the list with more ifthenusethis texts. Also negatives, if such then use y instead.
Try constructing reusable components out of what you are doing instead of building everything up from basic building blocks. This also allows more concrete testing of individual parts and then if you want to change the look you can change it in one place and have it apply everywhere.
Agentic development doesn’t mean “throw all what we learned out of the window”, the same practices that helped speed up and improve quality of work of humans also helps agents. In fact, the multiplier is even bigger. You will notice it in development speed and reduced cost due to avoiding churn.
I’ve seen many open source contributors deflated because they wanted to share their code/solutions with other individuals and the world to learn from only to have their work sold as a service by a big cloud vendor without seeing something back for it. Or maybe even getting more work back to support the cloud vendor for free.
So I’m not surprised at all that licenses that allow commercial use up to a point and above that require seperate license or contributions back. It is still open source in a lot of ways. Can still be part of other open source distributions that themselves make no profit etc. And only companies that are more than able to pay must pay something.
That also doesn’t help with load. So besides what agents are doing themselves the AI companies also have a responsibility of being good citizens.