Can’t you run larger models easily on MacBook Pro laptops with the bigger memory options? I think I read that people are getting 100 tokens a second on 70B models.
Can you link - I am answering an email on monday where this info would be very useful!