Yeah and for some reason limited to only hardware support of H100. Even the cost of doing it in software is outweighed by the speed & storage gains from it
Yeah, I'd expect the most value to come out of 2 bit mantissa 3 bit exponent 1 bit sign setting.
Actually could probably try it on its own: a lookup table for binary ops over 6 bit arguments is just 6/8 of 4kb.