684 karma · joined November 23, 2015
The benchmark itself is very new and meant as a way to provide a baseline to judge progress in coming up with new ways to address LLM hallucination - the biggest challenge facing LLMs right now.
This project is an attempt to create a common metric to test LLM's for progress in eliminating hallucinations; the most serious current problem in widespread adoption of LLM's for real world purposes.
Method seems to be multiple choice trivia tests with real world answers, trick/fake questions where (I don't know) is correct answer, and 'None of the above' type questions. GPT-3.5 hallucinates but is much more willing to admit uncertainty than either GPT-3 or Alpaca Lora.
If the individuals indicted ever stand for the crimes they are alleged to have committed, then we will see the evidence as it will be a public trial albeit with any evidence that will reveal national security secrets redacted from public view.
This is exactly how our justice system is supposed to work.
Which is what he's currently doing. When they do finally admit that LIDAR is necessary, Elon will play the "no body could have foreseen this situation and we were operating under the best knowledge at the time" card.
He's bullshit all the way down.
If not, then any person can make a fork of an OSS project and charge 1 cent and it is now a "commercial" project and can no longer be hosted on ultimate/gold. It is not defined and Gitlab can use this ambiguity to at any moment start seeking rent...
It's a scam.