Hacker News Reader

ChatGPT uses a 1.7 trillion parameter model IIRC. I wouldn't expect a 70b model to compare well. There are medical finetunes that might be better to try for this, like https://huggingface.co/wanglab/ClinicalCamel-70B

Edit/Correction: as mentioned below, free tier used by OP is in the neighborhood of 175b

View on HN

Where are you getting the 1.7T number from? Genuinely curious, as sources like [1] generally cite 175B.

[1]: https://ecoagi.ai/articles/chatgpt-parameters

I'm not sure, I've tried looking it up and couldn't find an official answer. But that site says GPT3 is 175b and GPT4 is 170 trillion. That's insane if true

Edit: and this one says 1.7, idk https://levelup.gitconnected.com/gpt-4-parameters-explained-...

Haven't used chatgpt in a bit, but looks like the free tier is GPT3 still, so 175b may be correct if OP isn't a subscriber

I was testing on GPT3.5-Turbo, the free tier.

Ah, 175b it is then. That's actually kind of encouraging that an open source trillion+ param model isn't needed to get there.

A 180b Falcon model very recently came out https://huggingface.co/tiiuae/falcon-180B A finetune of this might be competitive, but I haven't tried it.

That should be in your article.

Reply on news.ycombinator.com