I’m running mistral 7B on a M1 Mac 8GB just barely. It’s ask a question get a coffee type of thing. No idea how this works, as 32 bit floats require 4 bytes and with 7B it would need to be swapping with the SSD.

If I had the cash I would go for 24GB M2/3 pro. That would allow me to comfortably load the 7B model in to ram.