Why int4? There are a lot of superior 4 bit formats like nf4 from bitsandbytes.