How much RAM/GPU/CPU is required to run the chatGPT / GPT3 model (aka text-davinci-003)?
Facebook came with an optimization a couple months ago so it takes only half the memory, so about 175GB for GPT-3, not sure if OpenAI has implemented that yet.
BLOOM, which is around the size of GPT-3, though not as good currently, works with these optimizations and should then be possible to run with 8x 24GB consumer GPUs.
Huggin face has a nice blog post on this