434 karma · joined January 7, 2023
Uses tmux and gh https://github.com/Kyu/claude-pr-watch
10 groups of 3 researchers, all have their own benchmarks that they do not share (testing it without the authors knowing is a different problem, maybe they only run the benchmarks when the gen-pop has access to the models).
that's 10 different tests. Aggregate pass rates
Neither prompt was enough for llama3.3 or gpt-oss-120b
This is toxic to you???
One look at the top H1B employers should stop this narrative however, because those companies do not pay near peanuts.
https://www.uscis.gov/tools/reports-and-studies/h-1b-employe...
Take yourself outside of that, and imagine you invented earth, added an ecosystem, and some humans. Wheels were invented ~6k years ago, and “humans” have existed for ~40-300k years. We can do the same for other technologies. As a group, we are incredibly inefficient, and an outside observer would see our efforts at building societies and failing to be “brute force”