There are open datasets (see the chatllama harness project and its references). You can of course also cross train it using actual ChatGPT.
> You can of course also cross train it using actual ChatGPT.
You mean train it on ChatGPT's output? That's against OpenAI's terms of service.
And the TOS violation might be the case, the project nevertheless has a mode to use OpenAI in the fine tuning steps.
Oh no, someone call the internet police.
I'm sure scraping tons and tons of images and web data to train DALLE and GPT and then selling access to that data to others was also against many licenses and terms of services, but OpenAI did those anyway.