Hacker News Reader

Comment by jejeyyy77 | Hacker News Reader

Is there though? It's just a matter of swapping out $BASE_API_URL.

Most of the clients I'm working with aren't interested in the base level of service. They are looking to further train the models for their specific use cases. That's a much higher barrier to switch than replacing an API. You've got to understand how the underlying models are handling and building context. This sort of customer is paying far more than the advertised token rates and are locked in more tightly.

not really. fine tuning generally just involves running tailored training data through the model - the actual training algorithm is fairly generalized.

For example, the Dreambooth fine tuning algorithm was originally designed for Google's image, but was quickly applied to Stable Diffusion.

You have to rebuild all your prompts when switching providers.

Do you? They're natural language, right?

You don't have to, but they will have been optimized for one model. It's unlikely they'll work as well on a different model.

I can't wait for TolkienAPI, where prompts will have to be written in Quenya.

I can’t wait to hire Stephen Colbert to write prompts then

No problem, just ask ChatGPT to translate it in Quenya.

If the superlative LLM can’t handle prompts from another provider, it just isn’t the superlative LLM.

This area by definition has no moats. English is not proprietary.

Use case is everything.

Switching to another LLM isn't always about quality. Being able to host something yourself at a lower or equal quality might be preferred due to cost or other reasons; in this case, there's no assumption that the "new" model will have comparable outputs to another LLM's specific prompt style.

In a lot of cases, you can swap models easier but all the prompt tweaking you did originally will probably need to be done again with the new model's black box.

Host something yourself also for educational reasons, just experimenting, this is how new applications and technologies to be discovered and created.

I imagine AI would be able to perform the translation. "Given the following prompt, which is optimized for $chatbot1, optimize it for $chatbot2".

technically true, but the way these prompts are/can be template-ized it should be relatively trivial to do so.

Reply on news.ycombinator.com