Hacker News Reader

> LLMs are not going to benchmark your code

If I may focus on this particular line without invalidating the rest of the content -- why aren't they going to benchmark the code?

View on HN

You hardly need more than a simple script to just run a generic benchmark tool. But to measure performance of your code and figure out what needs to be tuned, I don't think LLMs are there, am I wrong? They can't understand the code they generated well enough to make small adjustments and improve the benchmark score. For a dev to do that on LLM generated code, it would have to understand the codebase as intended by the LLM at least.

I had them write me performance tests. I guess I could go back to that and ask it to improve the code based on the output. You can feed the output automatically now with Roo Code, Aider, Cline, windsurf, cursor, augment, etc.

Reply on news.ycombinator.com