See also https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A..., which fits in a 24GB card through a special 2-bit quantisation.