Hacker News Reader

this appeared some time ago, https://taalas.com/, but I'm sure there's others thinking these same thoughts. this would be best for small models imo, nothing frontier because that changes too fast

View on HN

you can try it out here: https://chatjimmy.ai/

that's so fast it feels fake

13,789 tok/s

Well I've gotten one of those "holy fuck this is the future" deeply unsettled anxious feelings in my gut again. It's been a week or 2, it was time.

i only found one discussion of the tech here on HN

https://news.ycombinator.com/item?id=47103661

It's indeed super fast, but the output is complete BS hallucination. Not sure what's the value of this.

It's a proof of concept that it's possible to etch a neural net into a chip and get massive performance (and efficiency) boost

Reply on news.ycombinator.com