1,634 karma · joined January 24, 2012
But this sort of theming specifically is something that was experimented with a couple decades ago and given up because people wanted simplicity and consistency instead. It’ll be exciting if LLMs reverse the trend.
I’d still maybe ask it a few more things before concluding that it’s useless. It’s meant to predict plausible responses and provide confidence scores, not compute real-world probabilities of events.
For an LLM, the keys are the tokens in your context, and the values are … what exactly?
To me it reads a bit like, how we built our office without desks: it turns out if you stack two chairs on top of each other, you can balance your laptop on the top and you’ll also have a shelf on the bottom for your things.
I’m stealing this.
Because it left you fewer opportunities to experience the ecstasy of typing git commands into a terminal? Or because it didn't work so well?