The full use case includes quantisation, which the repo points out uses a large amount of system RAM. Of course that’s not required if you skip that step.
I would not personally call compilation of software part of its "use case." It's use case is text generation.
Or it is probably possible to make it work slowly using a swapfile on Linux.