It's still going to be a little worse than frontier models, and for some people that can be enough to pay $36k/year.
Oh and prefill is still a lot worse on local LLMs. Like 1-2 orders of magnitude worse.
Oh and prefill is still a lot worse on local LLMs. Like 1-2 orders of magnitude worse.
No comments yet.