I think this already happens through Mixture of Experts which is now build in to ost models.

But finding out what an LLM needs to understand from a business side to write your code good, is an otpimzation which no one cares currently.

I'm pretty sure we either stay on big full frontier models for a long time, just use them for everything or we will start to see more and more people doing finetuning/project specific training like java + german + english + business contxt xy;

It will be an indicator for the whole industry.