Do you expect LLMs to get those ones right?
Do you expect LLMs to get those ones right?
There are many problems where the solution would take me a few hours to derive from scratch myself, but looking at a solution and deciding “this is correct” or “this is incorrect” takes a few minutes or seconds.
So I don’t expect the junior or the LLM to produce a correct result every time, but it’s quick to verify the solution and provide feedback, thus I have saved time to think about more challenging problems where my experience and domain knowledge is more valuable.
"It's easy to decide if a solution is correct or not." Yeah right. So you have metrics for it?
I've read other people's code for 25 years for a living. I'm pretty good at it.
So when I get a piece of code or an algorithm, I can read it check if it looks like something I'd allow in a pull review.
We also have this thing called "unit tests", which are pretty good at detecting erroneus code. Some people even write them first and then adjust their code to match.