Hacker News Reader

> People at the big labs have been terrified of losing the chain of thought

An irony here is that by hiding their own COT for (anti-)competitive reasons they've made latent reasoning models more palatable to everyone else. Those of us who primary open models are rather addicted to reasoning access and wouldn't be quick to give it up for a small performance improvement. But if you're used to concealed reasoning of BigLLM, welll.....

View on HN

Hint: you can have a small fast cheap model fill its context with "hints" (like: use tool X if Y happens, Z is a dead-end), let it watch the big model's thinking tokens, and drop hints to it (by injecting thinking tokens that the model didn't output).

Then let the big model add hints and you have a kind of memory that doesn't require the big model to actively query it.

Reply on news.ycombinator.com