"Critically, the computational cost of trialing, training and testing the system was less than 300 USD dollars."
Is this a joke?
What exactly did he do? Training the system how? Does ChatGPT allow APIs, let alone training on some corpus of data?
Is this a joke?
What exactly did he do? Training the system how? Does ChatGPT allow APIs, let alone training on some corpus of data?
https://platform.openai.com/docs/guides/fine-tuning
The largest Davinci model currently costs $0.03 per 1k of training tokens during fine-tuning, so you could fine-tune a model on 10M tokens for one epoch at a cost of $300.