Hacker News Reader

GPT-3 costs $4.6 million dollars to train currently[0]. Not only is your comment unnecessarily negative, it's just generally a pretty bad take.

[0]: https://lambdalabs.com/blog/demystifying-gpt-3/

View on HN

What value is added by training a model yourself? Why don't they provide that model?

Isn't the real innovation here to give people a $4.3 million model for free?

Instead of letting people burn unnecessary compute power to train a model 2 years behind state of the art.

The main value is that you can choose your own training data. For example, if you wanted to train a text-generation model on purely C++ code, this would be a good way to do it.

They don't provide that model because then it can't be rented out to people with less upfront cash for insane profit.

Reply on news.ycombinator.com