Come on Apple, do better.
15,751 karma · joined December 29, 2009
Book: https://www.manning.com/books/terraform-in-depth
Portfolio: https://projects.tedivm.com/
Github: https://github.com/tedivm
BlueSky: https://bsky.app/profile/tedivm.com
Fediverse: https://hachyderm.io/@tedivm
LinkedIn: http://www.linkedin.com/in/roberthafner
Comments are my own and not those of my employer.
Come on Apple, do better.
* With jev-sec-bench the confidence numbers reached roughly the same as Qwen2.5-7b-instruct (confidence was off by about 6% on average in both cases).
* On the OpenRouter Banking 77 benchmark Jev did the worst out of all the models, being about 25 points off from reality.
I also think the fact that Jev hasn't published any real papers or actual technical details should make people a bit more skeptical than they have been.
https://www.propublica.org/article/draftkings-sports-gamblin...
This is something I've seen happen a lot with Google- their employees (especially the director+ folks) are absolutely rabid on social media when it comes to defending their products, and they don't let little things like "facts" get in the way.
Google needs to get a better social media policy because they look like clowns when they do this.
I'm a bit disappointed that they didn't call out how much bullshit was in that statement. They are just changing the default settings for new customers. That's it. All the deployed cameras remain the same, and new customers can just toggle those settings off of the defaults. It is so obvious that they were attempting to get credit for doing nothing, and reporters should call that out.
There is no separate enterprise platform unless you buy their self hosted server product.
That said if the only issue is time, researchers will just run their automated analysis through machines with dates in the future alongside their normal tests.
The 35B model is an MoE (mixture of experts), which uses only a subset of parameters at a time. The 27b one is slower but has way better performance.