TPU 8tx and TPU 8i Max
blog.google
blog.google
https://cloud.google.com/blog/topics/ai-infrastructure/intro...
https://github.com/Niko1221/Strata/blob/main/docs/HOW_IT_WOR...
They could still be renting them out.
Then again, if they can provide competition to Nvidia, it may force Nvidia to lower prices across the board.
And even if Google sold them, they probably won't sell any affordable ones. Nvidia sells DGX Spark, but who can afford to buy them?
https://www.msn.com/en-us/technology/tech-companies/oracle-e...
Interesting times ahead with a number of chip makers now vying for this market. TPUs are a mature chip now which gives some strong advantage. At the same time as the TPU announcement, they also mentioned they'll be deploying Cerebras systems as well.
And how does each compare to their NVDA price equivalent?
(It's "Tensor Processing Unit".)
Also, it doesn't just come out and say what the peak throughput of these chips are, just 2.7x the prior generation. This is one of those things that Apple does every Mac release--it's always some big dumb bar that is bigger or some line up and to the right that has absolutely no explanation.
would it kill you to use an internet search engine (such as google)?
However, consider the Tolkien community. I enjoy lord of the rings and want to know more. But there's an absurd acronym for another book (home) that no one ever expands in that community. And it's not in the wiki's and it's not in Google (bc what do you get if you google "tolkien home"?) it was intentionally frustrating for me to figure out what that acronym was. The people in the tolkien community also adopted your pov and just wouldn't help, expecting new people to bootstrap themselves. It was not a fun experience. These styling conventions aren't for the 99% of the time they're for the 1% of the time.
But yeah in general it's nice to at least explain the acronym once
And what I'm saying here is different from "you should not ever care to expand acronyms/abbreviations/initialisms", but that does not necessarily mean your goal should be that it's "fun" for every possible person (you'll never achieve that goal, under or overexplaining is never fun). It's about what's reasonably efficient for everyone likely to read the article. If 50%, 10%, 1%, and 0.1% of your audience will understand an acronym, abbreviation, or piece of jargon then it has different implications for what the right balance of reasoning is. Not every piece need target a generic audience, not every acronym need assume the reader can't be bothered to learn anything not spelled out for them in the page, and not everything is equally hard to figure out when it's not spoon-fed to the reader.
And, again, what is "Tensor Processing Unit" going to gain you if you don't already know that's what TPU stands for in the context of this article? I.e. who knows what a tensor is and why youd have a processor for them yet gains something by the acronym being expanded? People who don't know what a TPU is should start with a different article completely, probably several, and then read this one. Expecting every piece of writing should assume no knowledge blocks more knowledge than it helps share.
One thing I think the "lucky 10,000" XKCD gets bang on is that it doesn't frame sharing something with the 9,999 in mind as error any more than it blames the 1 for not knowing - instead the problem is dogging people for saying they've never heard of something. That's truly a golden rule, regardless the audience and so on, and doesn't require changing the way humans write to avoid problems like the one you ran into.
> We first designed Tensor Processing Units (TPUs) more than a decade ago motivated by Google’s...
Literally all it takes. Basically free and it helps both broaden your audience and avoid mistakes. Also, high key, it is a great opportunity for a back link to https://cloud.google.com/tpu, which you'd think Google would care about.
You benefit indirectly because it gives Nvidia a competitor in the datacenter space and takes some pressure off the GPU market. You can also rent them on GCP.
Did you by chance fail to read who builds these things?
> TPUs are now a rapidly growing business with nearly 100 customers
‘Nearly 100 customers’ in 10 years isn’t very impressive
So basically Google has both SOTA models (Argon and Carbon and top of the line TPUs, but...
Google is in trouble?
(reading HN search is dead and hence Google is done)
> TPU 8i Max for massive context windows and the highest compute density per rack, and TPU 8tx for secure and confidential inference
You had one job, Google
I love it when companies expose their org charts publicly like this. As if anybody cares that they think about Google and DeepMind as different.
Or you'll get charged, but some obscure internal flag will be out of sync and you can't get ahold of anyone to reset it.
/sarcasm at the unoriginal naming scheme
You are not the target market.