totisjosema

Cool!

There are 3 game modes, and each tests different things, (and yes game 1 is almost impossible for a human). However it feels like you would do great in streak, where correct answers is all that matters.

Also incorporated your feedback on versus mode :) Most accurate always wins (the systems point accounts for this)

Thanks!

A quick update, I took some QoL feedback received in comments and also added 300 new cards so play stays interesting.

Also Ben... Whomever you are I know you cheated, and... will allow it for now ;)

Yeah, the solo play is fun, but with friends its much better

Good job, there are some insane scores, you already better than the majority of us

Well, good that you beat Jev anyway , not many do :)

Thanks for the feedback, and you got the purpose of this little app exactly right. Each game mode tests different things. And it shows the strengths and weaknesses of this model. In streak almost all humans will win, but in sprint very few, however, very good humans will still beat the machine.

Jev and decision models, can make decisions very fast, in this quiz with around 80% accuracy, each use case will need to define if its good enough or not.

Each game mode tests different things. Sprint is all about speed, it will be hard to beat JEV if he doesnt fail but one failure adds 15s. So you have a chance (in fact JEV gets around 80% right)

Versus Measures accuracy but under time pressure, if you score more than Jev you will win.

And streak is also accuracy.

This quiz game, is supposed to visualize how good and bad these type of models are. They can be very fast but they can also fail 20% of the times. As a human, can you beat that?

haha, wait until you get asked which is a dolphin

Jev has been humbling many today (including me) Still fun to play tho, invite some games and play with them.

Jev did not take 60 seconds for sure, with answers in 200-300 ms averages, more like 2 seconds.

You get very high scores if you are fast and accurate (which Jev is most of the time), and you get punished hard (15s) if you are wrong. The game balances speed and accuracy.

Will try to improve the cards that didnt work for you, thanks for the feedback!

A coin flip with 80% chance of success tho (and 100% in some categories)

will add more cards, thanks for the feedback

sorry you saw it that way, was just kidding, there are many categories unlucky of him that the one he doesnt like landed on his deck Anyway the feature he requested was literally on the app 5 minutes after he asked :)

Thanks for trying it out!

I failed that one as well, learn something new every day I guess

Jev gets around 70-80% right. Varies a lot per category. But its quite surprising that its soo good in some of them

Its a combination of time and correct/wrong answer. But the game had not been played by these many people before so it can be that the scoring mechanism is not fully calibrated. Thanks for trying it out!

Thanks! Yeah built with claude code.

Thanks for the feedback! And now that you showed everyone a cheat sheet we will get many high scores, so lets increase the penalty of wrong answers and reset the leaderboard! Thanks a lot for the insights

Will take a look, should already be there during a game though

just play again :), but will consider adding whitelist/blacklist of categories

yeah the different games play to different strengths, you can play multiplayer with friends also

Play some more you will get the hang of it :) The first 200 cards I did: Jev got 160 right, at a median of 261 ms , so no need to feel bad

I have had quite some interesting reads just looking at the reasoning to be honest. The frontier models seem to have relevant sounding arguments every time, its even hard sometimes to read through the bs , identify what its actually a good argument and what is an argument I would like to read.

Which AI lab has higher ethical standards:

https://opper.ai/ai-roundtable/questions/8f5b4f55-617

Do you think its alright that AI labs scraped the internet without respect for copyright and now sell closed models?

https://opper.ai/ai-roundtable/questions/86864de8-251

Very interesting to read the transcripts. And seeing how they manage to convince each other. Opus 4.6 seems to really get the others changing their minds

What is your experience so far with the quality of the retrieved pieces?

Didn't they buy Sana recently as well?

Love the visualizations! For someone that learned these algorithms years ago, it is still nice to see them visualized!