Improvements to the fine-tuning API and expanding our custom models program

There's some exact words shenanigans here. Indeed may have reduced the number of tokens in the prompt by 80%, but they didn't reduce the cost by 80%: the prompt cost of inferring from a fine-tuned GPT-3.5-turbo ($3.00 / 1M tokens) is 6x the prompt cost of inferring from the base GPT-3.5-turbo ($0.50 / 1M tokens). If prompt tokens are cut to 20% of normal, then that implies the overall cost of the prompt tokens is 120% relative to their normal prompt: a cost increase! That's not even getting into the 4x cost of the completion tokens for a finetuned model.

Of course, Indeed likely has an enterprise contract reducing costs further.

Given the disproportionate amount of lawyers in any given legislature, never mind the make-up of judges, I can only imagine that a legal stranglehold insulating lawyers from the threat of AI will be one of, if not the, first bit of AI protectionist legislation.

That said, we've found that Mixtral fine-tunes still typically outperform GPT-3.5 fine tunes, and are far cheaper to serve. This next part is a bit of a plug, but I honestly think we have the simplest platform to fine-tune multiple models (both API-based like OpenAI as well as open source alternatives) side by side and compare quality. https://openpipe.ai

The CEO was (up to a credible consensus of primary sources) fired for self-dealing in borderline criminal fraud-level ways. I’m not aware of anyone disputing this with any vigor. Then that CEO was fired again for more vague but thematically consistent allegations of flagrantly profiteering off an ostensible charity actively lobbying for de-facto regulator status. Then that CEO made a token concession by disposing of yet another in this cavalcade of personal financial gain presented as urgent imperative.

And the most moderating influence is a guy who has been run out of everything from politics to finance to prestigious academic posts over scandal after scandal in print for 35 years running, and has yet to issue an apology I’m aware of.

But the really high thread-count noose is that Opus is mopping the floor with GPT-4-1106 and 0125, on money that would fall out of Nadella’s couch cushions. And it’s dramatically operator-aligned.

You can’t be a society-scale criminal, keep it up for over a decade, and get lapped by vastly less-resourced competitors in the Valley. You shouldn’t be able to do any of that and still wield any power.

This new breed of tech titans have forgotten something their predecessors knew: it took Wall Street a century to utterly capture its regulators.

Tech people who go big enough? Holmes is serving time, SBF is serving time, they’re not the first.

This isn’t about corrupting the competitive landscape anymore geniuses: this is about staying out of prison.

It's the sound of another opencore AI startup unknowingly participating in NVDA arbitrage becoming irrelevant overnight.

   "There are a variety of techniques that developers can use to (...) reduce costs."

I just wish they let you make new accounts after deleting an old account, apparently it's something to do with the database when I ask them about it, which suggests that they store data about users even after someone deletes their account.