Hacker News Reader

Hacker News

Comment by dinobones | Hacker News Reader

Full thread

dinobones

This is a good product but the naming/branding is pretty unfortunate.

Typesafe.AI sounds like some typescript/structured output type of tool…

What even is “system one” ?

IMO the product/tech is really there, just needs better communication.

View on HN

The model can't reason comprehensively (e.g., like Sol XHigh would to solve a complicated problem), but it's designed to be able to answer anything a human reasonably could quickly and intuitively, i.e., system one thinking: https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow

I wonder how well it can play chess, or go.

I was wondering the same! So I asked Astra to build me https://jev-chess-master.vercel.app/ where you play against Jev AI as chess player.

You play White, and Jev plays Black. Rather than asking an LLM to generate move strings or JSON, the backend feeds all server-validated legal candidate moves into Vercel AI SDK's experimental_evaluate(). Jev picks Black's move and outputs its probability distribution across all legal candidates in a single forward pass (~300ms, ~$0.00004/move).

Github link: https://github.com/qibinlou/jev-chess

Give a try and let me know your thoughts! I am having lots of fun coming up with different chess strategies for Jev to try out.

Thanks for the demo. It plays very bad and blunders pieces on every move.

I am horrible at chess and easily won. It does play very very badly.

But it is essentially playing bullet chess right? No time to reason and is basically forced to go with it's knee jerk reaction. So maybe it plays reasonably against another average bullet chess player?

This is an instructive demo and makes me pause a bit when thinking about where I would trust using a classifier like this. Also there is no way to fine tune it right? So you are just left to its interpretation of the classification schema?

Building classifiers is hard and forces you into thinking about your problem space and your comfort level with type1 or type2 errors. I fear this will encourage sloppy work because all those decisions are black boxed.

Not like we were in a utopia careful ML applications before this.

I had a different initial confusion - it seems this company has no relation to the company formerly known as Typesafe https://en.wikipedia.org/wiki/Akka.io

Struggled to understand the use case till after i came across this https://eu.36kr.com/en/p/3991165197188099 article, which referred to them as the "referee for agents."

> What even is "system one"

I definitely agree it's underexplained in type safe.ai's materials.

I have to assume it's a reference to the fast, heuristic, intuitive "system 1" process in humans, as opposed to the slow, procedural, reasoning "system 2".

This theory is recognized, among others, in Daniel Kahneman 2002 Nobel prize on Economics.

You are correct, they state that on their website.

I mean, it's a structured output model that (apparently) can't hallucinate. I don't mind the name.

It can't hallucinate, but it doesn't mean it can't make wrong decisions. Just because it adheres to a specific output format at all time, while LLMs have the output format at their mercy, then the claim of not hallucinating is made technically true.

I think that this specific part is not super interesting if your harness just recovers from invalid LLM outputs.

The latency and cost - yes, those are super interesting.

You can get rigid output format from "classic" LLMs https://docs.vllm.ai/en/latest/features/structured_outputs/ though model support is limited.

Would like to have something like in the original post but open weights.

Reply on news.ycombinator.com