As much as possible countries should have sovereign technology, and as human "sovereign individuals" we should mix local models and public APIs for open models as much and makes sense - case by case.
21,557 karma · joined August 19, 2009
My recent books can be read for free online on my web site or optionally you can pay for them at https://leanpub.com/u/markwatson
Twitter: mark_l_watson and Mastodon: @mark_watson@mastodon.social
As much as possible countries should have sovereign technology, and as human "sovereign individuals" we should mix local models and public APIs for open models as much and makes sense - case by case.
I mostly use local models. I use pi with the strongest models my 64g mac can handle, and for fast light work I use ‘pool’ with Laguna 2.1 XS 6 bit quant. I am happy :-)
The food industry in the US is pretty much messed up. We try to only buy fresh produce and fresh fish, staying away from processed food - but it is difficult. I read something about the composition of the modern Butter Finger candy bar (fake chocolate, lots is chemically processed seed oils) compared to the almost wholesome ingredients used 30 or 40 years ago.
Finally, Apple has a great tool called ScreenTime that I can set limits on HN, YouTube, etc. I set a 15 minutes a day limit for each, but I can always add 15 minute increments if I find a good rabbit hole to explore.
I suspect that I am slightly more productive in VSCode for large code bases, but it just makes me feel happier and content to use Emacs.
My hunch is that Google will end up being best for non coding tasks. Google can concede coding to other vendors who pay Google for infra.
AI should make us better, not just churn out trillions of lines of code.
The very idea of massive vibe coding efforts, where devs go to sleep with a hoard of agents churning away, makes me uncomfortable.
Literally everything I do is Open Source software and Open Content writing so I am fine with the lack of privacy using direct Chinese APIs. And, for a little more spend, just use US companies like Fireworks.ai or Ollama Cloud for more privacy, or run on-premise locally and get the best grade of privacy.
I think NVIDIA does want small open models running on-prem to explode as a market! Lots of smaller GPU installations for companies who wisely want on-prem inference.
Of course NVIDIA will also keep making a ton of money selling to hyper scalers, but not forever: Chinese chips are getting better, Google, Microsoft, Amazon, etc. designing their own inference chips.
NVIDIA is handling this brilliantly.
That said, after being satisfied with Poolside.ai’s Laguna XS 2.1 4 bit quant, when I upgraded to a 64G Mac, I now only run the 6 bit quant and the results are better.
Unfortunately, I think that benchmarks are not useful for me, and I need to take time seeing what works for me: this is one reason that when I find a combination of model, harness, etc. that works for me, then I tend to use it for a month or two before looking around for new stuff.
Yes. I code Python in Emacs with the ancient Python support for running a REPL, loading buffers, editing a function and just hot reloading the modified function, etc.
I am an old man, and I like old man tools :-)
Progress on running local models has been amazing.
I also have two daily tasks for local events and things to do and also a tech summary of new tech news.
Good to see Europe adding toe what Mistral is doing. +100
I pay Google $5/month for Chat and my wife gets to share that: a fantastic deal. I even get a short weekly (one each) opus and gemini vibe coding sessions with agy.
I pay for inference: I paid $3300 for a Mac mini 64G M5-Pro which runs Qwen-3.8-Flash-Next (3 bit quant) with pi-dev and the results are so very much excellent enough for about 60% of my work and paying Deepseek for deepseek-4.1-flash with Deepseek Harness handles almost everything else.
I worked at Google in 2013 and I mostly like them as a company. I like their approach to AI in general, but I hate the business models of Anthropic and OpenAI and I fear the US taxpayer is going to pick up the tab on this one.
I think it is as easy as setting boundaries: practice meditation. Learn to enjoy sitting and doing nothing, both in the living room and sitting outside.
Then when the time is right, work hard for several hours to get important stuff done.
Food tastes best when we are very hungry, so we must go long periods of time doing mini-fasting a few times a day in order to enjoy food. Similarly, earning a living or experimenting with tech should be something that you sit down and do for a while, then do something else.
Wonderful toy, even though I only use it about 90 minutes a month it is worthwhile for me to own.
re: “”Start with the harness, because it is what makes everything else usable.””
I have written three harnesses this year (in Common Lisp, Python, and Racket Scheme) and it has been a fantastic learning experience. I have been using neural network tech since I was on a DARPA neural network advisory panel in the 198os, and I am even more excited (by an order of magnitude) than I was back then.
I think Tim has it right, and the hyperscalers serve a function of bootstrapping smaller systems, but they are far from the whole story.
1. update my old open source projects by searching for and fixing defects, adding tests and documentation
2. working on my own agentic coding harnesses, using the coding harness I am modifying to update itself. I am tightly in the loop
Sure, not highly practical use of AI, but I am retired!
I was the second featured Creative Commoner decades ago and I have published all my books using Creative Commons share and share alike, no commercial reuse for the last few decades.
I haven’t been considering AI training use to violate my use of this license, but I suppose it does. When I have some free time I think I will switch the license on my books to the CC license that permits commercial reuse.
I think there are (at least) 2 important things here:
AI training web scrapers should respect robots.txt, ai.txt, etc. files associated with content.
Privacy issues are a severe problem, and privacy and security issues should be ‘top of mind.’
As someone else here said: the Deepseek team makes training runs in tightly controlled sandboxes, and any hacking behavior is scored as a failure.
The problem we have in the USA is that financial (and political influence) are misaligned from what is good for society.