Especially with the new Raspberry Pi 5 performance. Faster CPU but also much faster data access with M.2 SSD support. Get an 8GB model, add large CPU/GPU heatsink, and add extra heat sinks on the RAM and SSD. It silently run forever.
I'm curious if we'll see 16GB and 32GB RAM options to make it easier to run models like Mixtral 8x7b?