Bitter lesson learned in 3... 2..
I know Dylan Field recently posted they made the Llama's 70B model do amazing things but the AI training field is an absolute snake pit.
But then again they have money to burn ig.
I know Dylan Field recently posted they made the Llama's 70B model do amazing things but the AI training field is an absolute snake pit.
But then again they have money to burn ig.
Fine-tuning an open-source LLM with reinforcement learning in order for it to be better at a specific task does not go against the bitter lesson at all.
That's fair because I am stretching it.
I think there's AI companies that understand and scale AI. Then there's the rest that are doing a modern version of writing domain specific knowledge using skills, and maybe a large collection of their own data.
Maybe these focused models outperform in their own niche similar to how hand-written rules outperformed in their own niches. But long-term, they get outpaced quickly by generalized approaches.