227 karma · joined January 19, 2013
Easy to put into a container and the first training with the defined data is already running (on a 16core, 128GB, Nvidia 3090 with 14GB available).
This is a good example of how investor behaviour can only quantitatively project what will happen in the future. Huang's bet on GPUs for high performance computing made sense in the long term.
Intel didn't have the staying power with the i860[1] a decade earlier (and of course had no idea how to offer decent developer tools). I tried really hard to develop meaningful and executable programmes with an 8bit card (DSM). CUDA was a revelation for me.
Edit: wrong link
Is there any more specific info available about who (llama.cpp or Ollama) removed what, where? As far as I can see, the server is still part of llama.cpp.
And more generally: Is this the moment when Ollama and Llama part ways?
I don‘t get the point to link will produce symphonies to the wikipedia page of Philip Glass. It is well known that he had to work as a plumber for decades.
In my subjective experience, a philosophical text will deal with a specific topic and name it in the title and less often the author. Papers with an author's name in the title often deal with the entire work or a phase of creation. Author names also often appear together with other names "Kant and Hume on Morality"[1].
So the list is for sure not about "… Most-Cited … Authors …".
[1] https://cyc.com
[1] https://github.com/Infini-AI-Lab/Sequoia/tree/main/Engine
[1] https://news.ycombinator.com/item?id=40019217
[2] "From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples" https://arxiv.org/abs/2404.07544v1
(Edit: format)
[1] https://www.heise.de/news/Google-Fonts-Abmahnung-Hotel-erwir...
But really, I prefer to have as many players as possible in the field of _open_ models available.
And I'm sure the reason for that is the garbage input. From time to time I have to perform quantitative code analyses in our so called enterprise repositories. And the results are shocking every time. I have found an extremely poor SQL code block to type cast many columns in hundreds of projects. It was simply copied again and again even though the casting was no longer necessary.
The training base should be sufficiently qualified (and StackOverflow ranking is obviously not enough).
But unfortunately it's probably too late for that now. Now inexperienced programmers are undercutting themselves with poor AI output as training input for the next generation of models.