Hacker News Reader

Comment by wodenokoto | Hacker News Reader

You can can't build an SVM-classifier for a ticketing system without domain data. You can ask an LLM to do it, and it will do it very well.

With the LLM you don't even need a data scientist to train the model, you just need someone who can connect to APIs. And the LLM is fine with adding and removing categories. No retraining.

It makes the initial faces incredibly fast. Then it is slow and expensive to run, so once the system settles, it becomes the target for model optimization, e.g, a dedicated, or semi-dedicated model.

View on HN

Yeah but here's the thing: Ease of setting up and how low that bar is, this is not the most important factor for most companies. Also, yes, you need data to do this with an LLM. In fact the LLM was trained on that data for you beforehand. This is not an argument because you can also buy a pretrained classifier.

You empathize the set up cost but ignore that the model is in the magnitude of a million x in size and compute cost of a classifier model. That's like comparing a CPU with an IC

I mean just have a coding agent do the whole process from start to finish. Tell it you want to seed an SVM from LLM runs on ticket data. I can bet that it'll do it all for you without much input from you at all.

I think AI is making people forget that code can be used for automation.

I see coworkers using AI for tasks like "visit an API endpoint, download a file, put it in S3". This is so stupid. Okay if you want to use AI, but use it to write python code to do that, why pay in tokens every time you want to run that task, it makes no sense

How do they use it like that? Like a once off action by the agent or is it embedded in a process?

No, they literally just ask. "Can you pull this file using this API endpoint and put it in S3"

Probably under the hood Claude creates some temporary python code or something.

But it bothers me, I don't know why. It's like paying a subscription service for the most stupid tasks

If you don't know what "python code" is, you'll just ask the AI to do the task.

But there are teams in your org that could write something in 10 minutes

Yes, after the biz unit spends a month talking with IT about it, it might take the developer 10 minutes.

I see this a lot among non-tech folks, who have a pretty thin understanding of the differences between "code" and "an agent". But do you see this among tech folks as well?

Your S3 case tho I think is a bit misplaced. You're right that if all your keys are configured correctly (API key, S3 key, etc) that a script to do that is like 5 lines in Python (once you get your venv going or use uv to setup the project lol), but tell an agent to just do the thing, and it will make sure that your API keys are in place and that you have access to the S3 bucket you're trying to write to and that the whole thing is in a venv, and then just report back that it's done.

Is it wasteful? Sure. For years I used to feel that way when I saw someone using a messaging app to message a friend across the hall in a loud room or when I saw someone taking a phone picture of their computer monitor and sending it. In the former case your packets are literally going from your phone to a central server and then onto someone else's phone in the same room. But, well, convenience wins.

Reply on news.ycombinator.com