https://github.com/bitexploder/fnfl-v100 -- I am still fixing the odd bug in it and it is really specific to ISTA IQ3_XXS and Unsloth UD4_K_XL in terms of what I have built. Some of the smaller benchmark data is out of date, like I think I got 32GB MoE cache V100 up to about 700-1000pps.