Of course, but even still the level of scale, clean data, and human supervision needed may be significant. It's reported OpenAI used an army of humans to generate question answer prompts and rate the model output.

They kept the details closely guarded and only hinted at how they did RLHF and transitioned the architecture to self supervised learning.