Hacker News Reader

I don’t want to be that guy, but why do I need a middleman for something llm do out of the box?

Forget the API. Even search engines have returned these results for years.

I can potentially see an angle with SLMs integrating with a self hosted version of this API, but it’s a bit niche.

>why do I need a middleman for something llm do out of the box?

Why use a token-burning middleman when someone has already done it for you?

Fine to be that guy! Let’s say you want to build a product that recommends concerts to people based on their music listening history. Do you want to pay for an expensive tool call and several second response time to surface answers back to the user? Yes of course you can build this yourself because SaaS is dead! Or someone else could maintain it for you :)

Reply on news.ycombinator.com