Hacker News Reader

They're so non confrontational. Their performance comparisons are against "CPU". Just come out and say it, even if it's not apples to apples. If the 3D-torus interconnect is so much better, just say how it compares to NVidia's latest and greatest. It's cool that midjourney committed to building on TPU, but I have a hard time betting my company on a technology that's so guarded that they won't even post a benchmark against their main competitor.

View on HN

The paper compares it to A100.

https://arxiv.org/pdf/2304.01433.pdf

Nvidia's last gen...

That's addressed in section 7.4 of the paper:

> The Google tradition is to write retrospective papers after systems are deployed and running production apps. Both TPU v4s and A100s deployed in 2020 and both use 7nm technology. The newer, 700W H100 was not available at AWS, Azure, or Google Cloud in 2022. The appropriate H100 match would be a successor to TPU v4 deployed in a similar time frame and technology (e.g., in 2023 and 4 nm).

That's not really addressing the point though, is it. That tradition at Google evolved when they had technology that was well ahead of their competitors, which they currently are not and therefore this paper is more like a marketing document than a recruiting resource. It's inevitable that people will want comparisons before buying TPU access and giving them a mapreduce style paper that comes out years after the technology is mature isn't going to satisfy them.

Have you tried to get an h100? Its not really possible right now

Reply on news.ycombinator.com