curiously, what real world usage actually uses FP4? AFICT, most of the LLMs still use BF16, and even the quantizations down to 4bits and 2bits end up back to 16bit or INT8 for actual computations.
...assuming the recent 1.58b paper doesn't render the entire float quantization approach obsolete by then.