Dropping human-in-the-loop reviews is inevitable - it's just a matter of time. You cannot design a Ferrari and then let the driver crawl its speed by manually pushing it down the road. And all the "real" companies I have worked with are not 100% but 1000% into the AI - the incentive is huge.
That is not the quote parent comment was about wasn't it or am I missing something?
In case of your comment, I could have agreed to some degree but what you say is also not necessarily true since we don't actually know if the new source control is the result of human creative input or if it was also suggested by the model. Having worked with these models extensively I am inclined to believe that both can be true.
Well, Anthropic used model A to output the version 1, and then used model B to rewrite the version 1 into version 2, so the handoff was machine to machine and not human to machine. I read that part of an article as if it was their internal assessment test of their new model B (Fable) capabilities so that they can see if the new model can find interesting things but by intentionally being vague and without implementing the bias into your prompt. I use this technique very often as well for two major reasons: (1) I don't know what I might be missing so I let the model do the unbiased exploration of problem space, (2) I am curious how far the given model has come with its capabilities. What Antrophic did in this case is an example of (1) and I wouldn't really call it creative since anyone could prompt the model with "rewrite this code".
While companies are heavily incentivized to speeding up, cutting costs, etc. I expect that friction imposed by the humans is not going to go away that quickly.
Where exactly do you see human creativity and spark in the loop or fresh, new, bold, creative ideas in
> We asked it to rewrite the whole thing, and with no further instructions
They simply asked the model to rewrite the code without suggesting anything to the model which counters your creativity argument, which I see many people make too, but which I believe is not correct anymore. Models IME already are creative in ways I personally find it difficult to compete with. I still occasionally find something that the model in the first iteration would not to but the model is already far superior with its capabilities than I am.
This is too vague for me to answer but I'll try - effective organization is the one whose revenue and net-profit per employee is higher than their competition. And fastest moving organization would be relative and tightly coupled to being an effective organization too. Reminiscent of a fail-fast culture without red tapes. Software "quality" is IME rarely a discriminator.
That reads as an example from GoF era. In practice, especially with complex software engineering codebases, which I thought you were implying by saying "large", these patterns barely exist because the problems being solved are often in friction with what is considered to be the "best practices" elsewhere (in the books, other much simpler codebases, etc.).
Now instead of the AI agents swarm you let 100 engineers making the changes on that large codebase. How do you keep the code "quality", which is a very subjective thing, while at the same time, as you say, keep the "fastest moving and most effective organizations" trait? Impossible without gatekeeping and thorough review process both of which contradicts your trait.
They almost certainly don't review the generated code, or at least not with the common techniques we used so far (human review), otherwise their development would be largely bottlenecked by the review process - and I imagine this is where 99% of the companies are at right now.
You're overconfident in what you're saying. Nobody really knows (yet) if LLMs can or cannot "think" or can or cannot "invent" new things. I'm inclined to think the opposite from you but smart people actually try not to hold the absolut stances and present them as facts when they're in fact not. What I have seen so far throughout a daily use on complicated things suggests that humanity developed a new form of an intelligence.
Leetcode was designed to collectively implement bias towards young talented people whose only obsession at that point of time is their work. So no kids, family, free time, and no financial freedom (mortgages, loans). Once you build such culture, it starts to grow and gatekeep by itself from within.
Last time I checked it didn't make any difference or whatsoever when compared to lld so I would not go that far by saying "mold is a reference in the world of linkers" - made a test just few days ago on 10M LoC C++. So, rewriting the codebase in another language just because doesn't seem like an investment worth doing when there's much bigger fish to fry.
> It was loading the data for a week already, and the speed of loading data has dropped to 4 kilobytes per second, and it will take years to load the dataset.
And then on 2nd of August
> It loaded maybe 1% of the data so far.
And then one year after
> I didn't load the data after a year.
> I tried it with the fsync removed, but even then it does not work
Ok, I find this more entertaining than I should and almost unbelievable. I know that this codebase was heavily written by LLMs but the execution can't be this bad?
What am I missing and why would Supabase buy the product which can't even load the dataset properly?
Do you make your professional career by building formally verified systems? I ask because I don't think that the reason comes down to "because most devs don't want to do formal verified system development". It's much more complicated of course.
I had it seen on servers that were typically reserved for the team but there was no official booking system for those machines. When you start using the machine you would typically put some note to make sure somebody else does not overrun your long-running tests or performance measurements.
I wanted to understand your background first because what you initially said is a very oversimplified view of LLM mechanics, and generally not quite the way how software is in practice written. Since you didn't answer that question, I will assume that you're not a SWE by a call. To give you an example of what I am trying to convey is: imagine a data-intensive workload hitting your storage/database/kernel implementation, and it's painfully slow, your customers are not happy. Then you as engineer sit down, spend days profiling and understanding the code, researching about existing algorithmic solutions to the same or similar issues found in the wild, you read some open-source implementations of viable approaches, you ditch some, some you take, you also read books, articles, other peoples experiences etc. And finally you end up, let's put it bluntly, with some sharded data structure by which you solve the bottleneck. It's not novel, the technique is so common and is already implemented across many many different products in slightly different flavors so I am wondering why do you think this is not a copyright breach but the LLM, which does more or less the same thing, is?
How do you know this is not true with other vendors? I'm not defending them but I wouldn't believe anyone in this business unconditionally. Anthropic agent fwiw is not open source, gemini and codex are.
They do invent code solution for the problem that exists in your codebase. Latter implies that the code solution LLM synthesizes is usually unique of a kind, so, it's not a copy-paste neither it is a simple extract from "another codebase" and adopted.
IMO they operate pretty similarly to humans - we synthesize our solutions, and therefore build-up our knowledge, by collecting knowledge from multiple other sources, including technical books and blogs, open-source code repositories, and our past experiences.
Benchmarks will be interesting to see but I doubt the cores alone will be able to reach beyond ~500GB/s of BW, and even if they match that figure it will be great.