Run LLM Locally – which open model fits your GPU or Mac, and how fast

Doesn't support my AMD Athlon 3000G w/ 64GB RAM =P -- nor my real consumer GPUs (older than 4 years)

(And yes, I do run AI on my athlon... it is slow but works.)

Another tool that isn't up to date on Apple processors...