ParentFull threadtarruda·This video [1] shows someone running at 4-bit quant in 48gb VRAM. I suspect you need 4x that to run at full f16 precision, or approx 3 H100.https://www.youtube.com/watch?v=dJ69gY0qRbgView on HN