In the future there's going to have to be a way to benchmark the "human-ness" or "intrigue" or "feistiness" of a model to show us if its getting better at what we want
In the future there's going to have to be a way to benchmark the "human-ness" or "intrigue" or "feistiness" of a model to show us if its getting better at what we want
Benchmarks are used as a way to show that a particular machine learning technique does better at some task. It’s a way for researchers to show they’re making progress that will be legible to other researchers. You can’t publish a paper saying “we tried it out and we think it’s better.”
In theory, a significantly smaller neural network that outputs at nearly as good a quality, should be able to chew through training data, and its re-enforcement process, much faster and cheaper, right? A more generalized, lower parameter model, is almost always preferred, as long as it works?
If the human feeling is all boltonable to the neural net later, there is no reason to discount this component as lacking potential to exceed current models.
This is important for researchers and implementers, not (immediately, ay least) end users.
Then, we can use this model to compare different LLMs and optimize new models - could be with genetic algorithms or just a human tweaking the model - so that the LLM maximizes whatever we want.