If you're finetuning your own model, the closed models being "incredibly higher quality" is probably less relevant.
It's somewhat rare to have a task and good enough dataset that you can finetune something else to be close enough in quality to GPT-4 for your task.