> H200 GPU with 1.5TB host memory,
While yes it's one GPU.. It's not exactly a slim one.
While yes it's one GPU.. It's not exactly a slim one.
And you can rent H100's and H200s for not that much per hour.
might need some odd system builds, improbable with current pricing, to replicate or better the ratio. such as a ~256 GB system for a 4090 (with 24 GB VRAM).