Hacker News Reader

how? There are no cot trajectories afaik. Each token is generated independently. "Analyzing the cot" is a natural language problem. One which we still don't know how to reliably solve. Besides throwing another defective model on it and calling it a breakthrough, of course.

View on HN

there is a number of different methods. One is a separate model/classifier trained with human annotation. Here's a paper by OAI: https://arxiv.org/abs/2305.20050

A separate model/classifier is just using the same broken tool to fix the broken tool. A model is not an appropriate solution.

> A model is not an appropriate solution

that's a bold statement without any supporting argument. more like an opinion really. specially trained classifiers can be very good. sentiment analysis has been a thing for a while now, there had been entire businesses built on this tech where being even slightly wrong can be very costly

You have a car whose engine occasionally dies when left to idle. The fix for that is not to have a second car with the exact same problem give it a bit of a tow every once in a while.

"very good" is the exact same level advertised as the base models they're "protecting". It's not good enough, otherwise we wouldn't be having this conversation in the first place.

Reply on news.ycombinator.com