How many 5080 16 Gig cards would you have to buy to run the same model, and what would that cost?
Muse Spark Open would require more than 1.6TB of RAM in its native precision (BF16) for the model parameters alone. In a 4-bit quantized (NVFP4) format, the model memory footprint is lowered to about 493GB.In any case, I'd much rather run GLM 5.3 Flash on that sort of hardware. Better fit for the performance profile, and will probably beat Muse Spark Open in most uses.