2x3090s run 70B at 4bit pretty well. Dolphin does great at least for chat. Very coherent.