Hacker News Reader

Comment by jacquesm | Hacker News Reader

It's all in the spec. If you one shot an application then an LLM is not so much a tool as it is a make-a-wish machine, and like with those genies in bottles, what comes out the other end is going to be a surprise, either positive or negative. But if you instruct an llm to write a very specific piece of code with a very well defined interface that you run through a test set that you yourself wrote then it can be very much like a tool.

How you use something defines whether it is a tool or not. And it's the same in the real world: I don't know how many objects I've seen turned into hammers, even objects that you really shouldn't be doing that with. Tool-like properties are put in by the user, not necessarily by the object.

View on HN

Unless your single initial prompt includes instructions to deploy the result in production, and then you press <Enter> and never again revisit the conversation or its outcome, then I disagree. Because in normal case, even if you have LLM zero-shot something, you're still there as the final acceptance gate. You decide if it's good enough, or if it needs to be fixed.

This makes LLMs still tools, even if they're very good tools, and often can zero-shot solutions to simple problems. But just because you often take the `accept` branch the first time around, doesn't mean you're not in the loop.

> This makes LLMs still tools, even if they're very good tools, and often can zero-shot solutions to simple problems. But just because you often take the `accept` branch the first time around, doesn't mean you're not in the loop.

That, 100%. As Eliezer used to say, there are no little XML tags on atoms saying "these are molecules of a hammer", "a hammer's purpose is to drive nails". Purpose rests with us. We design things to afford some specific purpose, not determine it. I too have used plenty of things as hammers that were very much not intended for that purpose, and I used hammers for things they were not designed to do too.

Being in the loop doesn't make LLMs anymore of a tool. How many software engineers can just take the vague description, bang something out, push to prod without talking, clarifying or discussuing with anyone in the meantime. Are they tools?

Reply on news.ycombinator.com