From https://arxiv.org/pdf/2402.08268.pdf
> We trained our models using TPUv4-1024, which is approximately equivalent to 450 A100s
> Inference for such long sequences requires a minimum of v4-128
So you'll need ~60 A100 for inference.
> We trained our models using TPUv4-1024, which is approximately equivalent to 450 A100s
> Inference for such long sequences requires a minimum of v4-128
So you'll need ~60 A100 for inference.
No comments yet.