Hacker News Reader

Comment by politelemon | Hacker News Reader

Surprised to see no Linux support, considering that it's a project that manages... docker.

While we haven't built Linux binaries yet (waiting to make sure we have _fast_ GPU support before publishing a Linux and Windows binaries) it does run on Linux. For example it's used to create and publish the "library" images (e.g. "llama2") on a linux server today

If you have the Go toolchain installed, there are some steps from building it from source here: https://github.com/jmorganca/ollama#building

Linux support is coming, you can build it right now by running:

`CGO_ENABLED=1 go build . `

Please note that you NEED to have Go 1.20

  CGO_ENABLED=1 go build .  
  # github.com/jmorganca/ollama/llama  
  llama/llama.go:141:31: undefined: unsafe.SliceData  
  llama/llama.go:172:52: undefined: unsafe.SliceData  
  llama/llama.go:211:45: undefined: unsafe.SliceData  
  llama/llama.go:274:10: undefined: unsafe.SliceData  
  llama/llama.go:275:3: undefined: unsafe.SliceData  
  note: module requires Go 1.20

Thanks for mentioning this!

Is this a project that “manages docker” or is it a project that has an overall design and command line interface that is inspired by Docker?

Definitely the latter!

Reply on news.ycombinator.com