Hacker News Reader

How does Llama 2 compare to GPT-4? I see a lot of discussion about it but not much comparison. I don't have the hardware to run the 13b or 30b model locally so I'd be running it in the cloud anyway. In that case, should I stick with GPT-4?

View on HN

GPT-4 trounces everything else available. I'd say that 70b is about 3.5 level, unless you're doing something where finetuning greatly benefits you.

13b is alright for toy applications, but the difference to gpt 3.5 (let alone gpt4) is huge.

Vicuna 1.5 13b seems comparable to GPT 3.5 to me, and the fact that you can run it locally on last gen commodity hardware is incredible.

I bought a dodgy used mining 3090 last year and now my computer is writing poetry in the terminal in real time.

Llama 2 has uncensored versions. For many applications that alone makes it superior.

I've been toying with llama-2-uncensendored via ollama[1] and it's hilarious and oddly liberating to just be able to throw anything at it, without getting the canned "Sorry, as an AI model bla bla bla" back.

[1] https://github.com/jmorganca/ollama

Reply on news.ycombinator.com