HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by btbuildem | Hacker News Reader
Parent
Full thread
btbuildem
·
Largest R1, as in the 671B? How do you accomplish that feat?
View on HN
oynqr
·
Just do it? Llama.cpp doesn't load the entire thing into ram. It mmaps the file and the kernel takes care of the rest.
Reply on news.ycombinator.com