ParentFull threadfebed·I think it’s using 4 bit quantized model (32MB - 46MB). See table 5 https://browser.mt/assets/D5.1.pdfView on HN