All strongest chess engine have at least one neural network to evaluate positions, including Stockfish, and this impact the searching window.
>how all good turn based game ai works
That's not really true, just think of Go.
4,957 karma · joined September 7, 2021
All strongest chess engine have at least one neural network to evaluate positions, including Stockfish, and this impact the searching window.
>how all good turn based game ai works
That's not really true, just think of Go.
They are dirt cheap. Same model architecture for the comparison: $0.30/M $1.00/M. Or even $0.20-$0.80 from another provider.
And more importantly batches, so taking the example from the blog post, it would be 32 tokens per each forward pass in the decoding phase.
You are doing the calculation as they were output tokens on a single batch, it would not make sense even in the decode phase.
Edit: the blog post is now loading and reports "1290 output tokens per image" even though on the AI studio it said something different.
I thought this was the start of a joke or something, I guess if you use LLMs you are a "LLM lover" then.
Reading stuff like this makes me question the entirety of the article.
You're not accounting for batches for the optimal gpu utilization, maybe it can takes 30 seconds but it completed 30 requests.
Well maybe for you and not the millions of people that use this technology daily.
It's not.
It all depends on the scale you need them, with the API it's easy to generate millions of tokens without thinking.
Sota LLMs do play legal moves in chess, I don't why the article seem to say otherwise.