Thats interesting. Which other models are open sourced that are in comparison to OpenAI? I would like to set it locally and give it a try.
Here's a guide to running BLOOM, another 175 billion parameter model, on your local computer, just using the CPU, maybe something similar would also work for Facebooks models. https://towardsdatascience.com/run-bloom-the-largest-open-ac...
With this you can expect it to take around three minutes for each word/token the model outputs.