HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by IceHegel | Hacker News Reader
Full thread
IceHegel
·
Will 405b run on 8x H100s? Will it need to be quantized?
View on HN
bddppq
·
yep with <= 8bit (int8/fp8) quantization
Reply on news.ycombinator.com