Hacker News Reader

Comment by SCLeo | Hacker News Reader

This is just inference. The core at most ML library is the auto differentiation capability. It will be extremely tedious if you are to calculate the gradients manually. Or, if you implemented your own AD, then it is effectively a minified version of a ML library.

View on HN

  llama.cpp/ggml.h

  // GGML Tensor Library

  ...

  // This library implements:
  //  - a set of tensor operations
  //  - automatic differentiation
  //  - basic optimization algorithms

> autodiff

There's a lot of

    // TODO: implement backward

in there

Ok thanks for digging deeper, I didn't realize that, and obviously that invalidates the excerpt I posted above

Reply on news.ycombinator.com