The paper compares it to A100.
> The Google tradition is to write retrospective papers after systems are deployed and running production apps. Both TPU v4s and A100s deployed in 2020 and both use 7nm technology. The newer, 700W H100 was not available at AWS, Azure, or Google Cloud in 2022. The appropriate H100 match would be a successor to TPU v4 deployed in a similar time frame and technology (e.g., in 2023 and 4 nm).