Hacker News Reader

I'm surprised that some of the cutting edge AI work is not being done in pure Rust. Why even have a binding layer?

Python seems to have won over the Data / ML world.

So I’d wager they use what they and their intended audience know.

Someone implemented llama on Go recently, https://github.com/gotzmann/llama.go

Wouldn't discard a rust implementation of some LLM architecture at some point

Hi! I'm a maintainer of https://github.com/rustformers/llama-rs. We're planning to expand our model support soon.

There’s also ggml, which is quite impressive considering they get whisper and other models to run on a phone.