Its running with a decent token/second (as fast or faster than I can read...) on my M1 Max MBP with 64GB of memory

Probably H100s to be safe. I use deepinfra.