> a strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token.
What kind of hardware do you need to run this?
What kind of hardware do you need to run this?
https://github.com/sgl-project/sglang/tree/main/benchmark/de...
=)