Hacker News Reader

Comment by whimsicalism | Hacker News Reader

Uh, what? Do you have any source that GPT4 on web is not gpt-4-0613? Because I do not think that is true, my guess is you just have different settings for the decoder

View on HN

Some time ago when people started reporting degradation, Logan.GPT (Developer Relations @OpenAI) clarified that the API models don't change.

This caused a lot of confusion because people thought that was a claim that ChatGPT doesn't change. He then further clarified that "the models are changing all the time in ChatGPT".

https://nitter.net/OfficialLoganK/status/1664476604658069511

GPT-4 in ChatGPT has changed so much and so frequently. I've spent an inordinate time using both, side by side, and it has mostly failed to replicate the performance of their API offerings. While I don't have examples on hand right now, you can also look for yourself. Just look at the network requests in the web inspector. Here's the description of the Default ChatGPT GPT-4 model:

    {
      "slug": "gpt-4",
      "max_tokens": 4095,
      "title": "GPT-4",
      "description": "Our most capable model, great for tasks that require creativity and advanced reasoning.",
      "tags": [
        "gpt4"
      ],
      "capabilities": {},
      "product_features": {}
    }

Note the context size is 4095. Their model has been heavily optimized for speed and, presumably, cost.

I do not see what that description shows.

From the OAI API, gpt-4 seems to be an alias for the most recent model two weeks after it is released. There has not been a release since 0613.

https://platform.openai.com/docs/models/gpt-4

e: from your edit,

"Note the context size is 4095. Their model has been heavily optimized for speed and, presumably, cost."

No, they are restricting context size to make inference on the chat interface cheaper but that does not mean it is a different model.

Keep in mind that the information in the link you provided only applies to the developer models, which are only accessible via API and OpenAI Playground.

OpenAI's developer relations person confirmed it a little whiles back:

> [..] I made the comment elsewhere, but the models are always changing in ChatGPT.

https://twitter.com/OfficialLoganK/status/166447707026357043...

I would guess max_tokens refers to the number of generated tokens, not the size of the context window. That at least is the meaning of max_tokens in the ChatGPT API.

https://platform.openai.com/docs/api-reference/chat/create#c...

Reply on news.ycombinator.com