Right but it probably takes like 8-10 H100s to run Claude Opus for inference just memory wise? I'm far from an expert just asking.
Does "one" Claude Opus instance count as the full model being loaded onto however many GPUs it takes ?
Does "one" Claude Opus instance count as the full model being loaded onto however many GPUs it takes ?
No comments yet.