I have not read the whole thing, but I'm not sure I understand the benefit of this vs. using an existing e.g. 4 bit quant of the model in question
This is our first version and yes, it will have some errors that will be fixed in the upcoming versions.