To be fair, the previous page has a bit more details on the hardware.
I can run LLaMA 65B GPTQ4b on my $2300 PC (built from used parts, 128GB RAM, Dual RTX 3090 @ PCIe 4.0x8 + NVLink), and according to the GPTQ paper(§) the quality of the model will not suffer much at all by the quantization.
Just saying, open source is squeezing an amazing amount of LLM goodness out of commodity hardware.