LLaMA-65B fits in 32GB of VRAM using state of the art GPTQ quantization with no output performance loss.
It requires some very minimal system RAM to load the model into VRAM and to compile the 4bit quantized weights.
But if you use pre-quantized weights (get them from HuggingFace or a friend) then all you really need is ~32GB of VRAM and maybe around 2GB of system RAM for 65B. (It's 30B which needs 20GB of VRAM.)
I would not personally call compilation of software part of its "use case." It's use case is text generation.
Or it is probably possible to make it work slowly using a swapfile on Linux.