Hacker News Reader

Very cool. What does it use the model for? Could you replace it with something lighter, like some classifiers[0]? Or do you need the chat? Besides the chat, what other tasks is the model used for? Thank you!

0: https://jeffyclassify.com/blog/when-llms-fail-at-classificat...

View on HN

I'm assuming each model might require it's own tweaks to work functionally the same?

Still it could be handy to be able to do that locally, maybe model tweaks could be shared back upstream.

The bridge between deterministic accounting principles to non-deterministic patterns trying to simulate it at will is a pretty big thing to cover.

Thanks Nico! The model rarely writes answers, it structure the query (what to count, category, period, grouping, comparison etc.) then plain code does the money math. For questions that code doesn't support, we use the model and label those answers.

We also have a checker that reads the query and we only show figures when the two readings agree otherwise the app rather say not sure. We also rely on a small embedder that returns the 8 past nns to serve as examples.

As for classifiers, the reading is partly classification already, with rules and fixed cues checked first.

Reply on news.ycombinator.com