8x H200s recommended:

https://github.com/sgl-project/sglang/tree/main/benchmark/de...