Hacker News Reader

My laptop is my primary and only work machine. I run a lot of VMs and operations on some bigg-ish datasets.

RAM disks are quite a good way to expedite these things - along with two SSDs.

M2 MacBook has 96GB at 14". One can use it to run LLaMA 4-bit instead of 3-bit.

I've run LLaMA 65B 4bit int using llama.cpp on an couple of year old laptop with 64GB of RAM. Not a bunch of extra left, but it does fit!

Qubes OS? Although 32GB RAM and 3TB storage are currently almost sufficient for me.

on a 13 inch laptop at that