Hacker News Reader

Given how good Llama 3.1, 3.2 and 3.3 were I'm genuinely looking forward to news on Llama 4.

3.3 70B is the best model I've managed to run on my laptop, and 3.2 3B is my favourite model to run on my phone.

I'd love to hear more about how you're using models on a phone. Have you written anything about it?

Honestly the one on my phone is more for fun than anything else - I use it to show people that LLMs can run on personal devices but rarely do anything useful with it.

I use the MLC Chat app from the App Store: https://apps.apple.com/gb/app/mlc-chat/id6448482937

My favourite example prompt for demos is "Write an outline of a Netflix Christmas movie where a topical-profession falls in love with another topical-profession" - customized for the occasion.

e.g. "Write an outline for a Netflix Christmas movie set in San Gregorio California about a man who runs an unlicensed cemetery falling in love with a barrister at the general store" - result here: https://bsky.app/profile/simonwillison.net/post/3ldthrqb6c22...

fullmoon is a good FOSS iOS/macOS client for mlx

https://fullmoon.app/

Oh neat, that one has a feature that I am missing from MLC - it logs your conversations and lets you revisit them.

Still a bit too hard to copy and paste transcript aback out again though!

Reply on news.ycombinator.com