3,072 karma · joined May 6, 2009
I was never in the "resell software" mindset, similarly to books, I don't sell those, unless I get a present that is mistargetted. No one gifts me software sadly.
And AFAIR all software is sold as a license since way back.
Only issue I recall might be with female Aleksandra (abbreviated to Ola) and male Aleksander (abbreviated to Olo, or Olek).
Others usually (if I remember correctly) have similar prefix.
Harness is important for model performance, but weights are surely mode important, without that you would have haiku doing the work.
Single account sounds more like a boomer thing.
The only PC peripheral I have with USB-A is a mouse dongle when I'm lazy and don't connect bluetooth - and that one I connect to the monitor.
All others are usb-c.
They are similar, but for different use cases.
But at my first work (begining of 2000s) there was one person that made a fun email, using From of head of company (or was it head of that particular division) to his coworker with congratulations for pay increase and promotion. It would be all great, but that coworker didn't catch the joke and replied to it (person in the From wasn't amused). Author of the joke was fired (which is not easy thing to do in Europe), some people don't catch jokes.
But I always thought NPM was what the author describes - just a random set of packages with git sources, which I thought was the main issue (leftpad etc.). Isn't that the case?
What about one system that just works and is there for "ages": maven repository?
Technical people are rather good at learning new things, and ollama situation is a good learning experience.
llama.cpp gets you more tokens/s even if you ignore ollama team bad behavior.
But why make an app when websites is enough? And I don't need to run n web browsers for that.
Also Ollama has other issues (like forgetting what it really is - a wrapper).
Basically one has two real choices for local LLMs: llama.cpp (if single user) or vLLM (if multi-user/enterprise).
For me local models is all about quality, and how to achieve that - e.g. by providing guardrails that test the job done.
Also there are smaller, still usefull models that can run on 8GB or less.
As for oprncode, doesn't the system prompt eat too much of the context? Local models are really constraint in regards contex, and opencode AFAIR uses a 10k of it or some thing close.
As long as there are just few "normies" using Linux, it is safe from corporations adding their "security", "safety" etc.
And FedRamp has some issues with data being sent out.
Our corp doesn't allow usage of local models because of concern about potential "agent sends out code to the net" issues.
But they don't, they have the "30 days", but just after that they add "unless ....". So the time period is vague.