Is LLM even applicable to many things though? If we want more nuanced and contextual vision, does LLM help?
I think it'd be fun to use vision models to pick up the interesting parts of an image, describe only the high-yield context as English text, and put them in a sort of Unix pipeline or node graph to connect it to other models that can input/output text. With fine-tuned or prompt-engineered LLMs as the intelligent centerpiece.
>Fine tuning models is where the future will be
Who would request fine tuning? Businesses?
Are you suggesting to build some sort of data set broker?