2,974 karma · joined December 10, 2021
Then I just pull in all my components. The ones I use will get compiled, the ones I don’t won’t.
Mostly works fine. Eventually you will run out of NVRAM to save binaries on, but another esp-32 is like $3.
Even then, you can get a USB to GPIO adapter. I don’t use RPis much these days and it’s kind of a shame because RPi + Python usually has a quicker dev loop than C + esp-idf. I need 5 of some of them though, and I’m not buying a dozen RPis these days.
I don’t have to care if the Washington Post or Financial Times have a political leaning, there are alternatives. Less so with Instagram. You can pry Facebook out of my mothers dead hands when that day comes.
Anything small and aesthetic is going to basically require resin. Warhammer minis and jewelry (tiny filigree) come to mind.
FDMs have gotten better, but you're still not going to get those fine sub-millimeter details like you can with resin.
Eg an agent that only runs off a webhook trigger doesn’t have a use for all the UI stuff Pi does (and you may not want the local state like Pi does by default).
I’m still sort of with you, I’d generally do ACP to an open source agent. You do get much finer grained control if you use one of these agent SDKs (there’s a bajillion of these as well).
Or I could have an honest to god farmer make that list now, ahead of time. Regular search could absolutely surface that.
But also, as someone who does hydroponics, you’re going to end up reading the papers anyways unless you’ve done this a lot. It’s not easy to pick out something like low iron from too little light.
An awful lot of mainstream movies do have fairly trite plots, with a predictable film style. That's not entirely hate, sometimes I really want to see Michael Bay blow up half of LA. I don't think the next Fast and Furious movie would suffer horribly from AI writing, it's never really been an "art" kind of series anyways.
I suspect it is, because the 2D -> 3D models I've seen are terrible, but more importantly the 2D -> 3d models are terrible. Noteworthy because I suspect the number of people who have 3D scans laying around is tiny.
What you're describing is vaguely how video games work, to my understanding. There may be interesting parallels if that becomes a technique (like how distant objects are sometimes still rendered, but at a lower resolution/polygon count).
There’s a substantive difference between ingesting other people’s work and hosting copies of fans knockoff models of their favorite characters.
It’s even weirder because in other mediums this wouldn’t even be a thing. Nobody gets nearly as up in arms about fans doing their own cuts of movies, or re-using characters in written fan fiction, or etc. Very odd to me how up in arms people get about this specifically for visual art.
I’m talking about them training their own models with a much more specific purpose.
You brought up choosing a menu option in a UI. Jev is really good at something like “find the menu option that best fits the users prompt”. That’s general, and requires a big complicated model.
Companies are usually more interested in something less variable. Ie the menu option they’re looking for is fixed. “Take an arbitrary website and find the Login button”. That’s a _way_ simpler model, and well within the abilities of many large companies to train.
You only need to pay Jev if there are so many variables the model basically has to be general.
Eg classifiers are a separate thing from LLMs and are literally only capable of structured output. It will output one of the X options it was trained to recognize.
I think some of this is that the Venn diagram of people who like AI and the people who like machine learning isn’t a circle. There’s a lot of “intelligences” out there that aren’t an LLM or decision model.
Jev is super cool, and it’s super cool that it can handle novel categorization. Most organizations aren’t spending the big bucks on novel classification, though. They’re doing the same thing a billion times, which means Jev has to compete with having a custom model built and doing your own inference.
It’s very hard to build something generic like Jev, but it’s fairly manageable to build something more specific that handles a single kind of task. Especially at the scale where OpenAI would care about your attention.
I don’t really understand neural networks and I managed to train one to do hand gesture recognition on an old Leap Motion. It’s a pretty limited domain, but it trains on the CPU of my decade old laptop in under 3 minutes. The accuracy is quite good too, especially when you discount errors from the Leap (like misidentifying which finger is extended).
They only ever get cancelled over money
A long term plan for a company is _at least_ a decade. If your plan ended today, it started in 2016 so it has had to survive COVID, inflationary periods, several trade wars, the rise of AI and now the side effects of the war in Iran.
If your long term plan has to adapt to those in real time, is it even a long term plan? Or is it really a series of long term plans cut so short they became short term plans? I can see companies adapting to just drop the long term premise entirely.
> municipalities paying the full cost of policing
Since we're talking realpolitik, this will never happen. In a first principles sense, it won't because it's unpredictable at the locality level (how do you set tax rates for FY27 without knowing what you'll pay out for this?). In a realpolitik sense, it won't because a) people don't like their taxes going up and would rather bank on it not happening to them, and b) the police will throw a shit fit and refuse to work when they realize they have to consider property damage while doing their jobs, and that the public will be _pissed_ if they crash a cruiser into a parked car while LARPing John Rambo.
> Ultimately we need out of touch voters to realize that unaccountable government can easily turn its sights on them, as well.
Good luck and godspeed. The latest stats say 56% of US adults read at or below a 6th grade level, so say it slow and in monosyllabic words lol
The absurd end of this spectrum is what happens when police damage a random persons property while chasing a suspect. They’re generally not liable for it, however most homeowners insurance won’t cover it.
I remember an early GoFundMe from a lady that went to work and a guy broke into her house and had a shootout with the police. She came home to being homeless (house got condemned because plumbing, gas, etc is bullet-riddled), and it’s a really disconcerting story to hear. I don’t recall if the city settled to quiet the story down or not.
This happens a lot because at the individual level, it’s sort of in everyone’s best interest to take the deal. The prosecutor wants $2,000 and 0 jail time and it all goes away. If you don’t take the deal, even assuming you win in the end, it will probably cost you way more than $2,000 and however long the probation check ins take. You will recover neither your time, nor the money you spent on lawyers/transportation/days off/etc.
At the macro level it happens because prosecutors get judged on their conviction/case closure rate, because we implicitly assume they found the right person. Browbeating people into accepting token punishments that technically close out the case counts for the metrics voters actually watch.
If I might lean a little conspiratorial for a moment, it also behooves the prosecutors office to flood the defense attorneys with cases. People will vote to raise the prosecutors funding to deal with criminals, no one will vote to raise defense attorney funding. Last I saw the average prosecutors office gets something around double the funding the defense gets.
It got so bad in some city in Oregon there was (is, really), a near constitutional crisis because the city got trapped between the provisions of the 6th amendment. Defense attorneys were so flooded they said they couldn’t take any new cases. The 6th amendment says the accused has a right to counsel, which is an issue. It also says they have a right to a speedy trial. The city was going to have to allocate money to the defense and get them lawyers quick, or drop a bunch of cases.
That never happened, the judge basically just said “Nuh uh” and I believe threatened the defense office with sanctions if they didn’t just assign the cases to lawyers who were already saying they had more cases than they could imagine.
I’m a little shocked we haven’t seen a huge wave of successful “ineffective assistance of counsel” appeals. Pointing to a signed, public statement your lawyer was overworked before you even talked to them seems like a decent starting point.
Is this related to the US govt banning internal DeepSeek use? A currency thing and prices are USD denominated? Chinese AI stocks were used to hedge and now aren’t?
I don’t see a purported reason, and it makes me feel like the article doesn’t want me to ask that.
OpenRouter's DeepSeek provider is basically this. Instead of renting H100's for dollars per hour, you pay someone that arbitrages the $/hr to $/token conversion because you can't actually saturate an H100 for hours. It's still effectively the same as running it yourself because of the ability to change providers to someone else arbitraging the same thing, and that there's always the escape hatch of switching to actually renting the H100s yourself.
To your point, I think we’re past the hump on the Pareto distribution. The models are good enough for most things, and the rate they’re improving at the things they’re bad at is dropping. The odds a new model is good at something the old one was bad it is okay, the odds it’s something you care about is dropping. It makes a lot of sense to discriminate on price rather than features in that environment.
People are saying _training + inference_ is unprofitable (I don’t have a dog in the race and don’t really care either way). That’s a lot of GPUs and salaries that aren’t generating revenue at any moment.
Personally, I would guess Anthropic and OAI are profitable. I just suspect that they’re a pretty normal level of profitable and not the absurd, near-alchemical “can turn dirt into gold” level of profitable their valuation seems to have priced in.
Countries used to enforce this at their borders (for foreign information) because it largely worked. They couldn’t stop 100% of the copies of the book, but they could stop there being enough copies for it to be part of the cultural zeitgeist (most of the time).
Not anymore. The companies don’t have a local HQ to harass, and the information doesn’t flow through infrastructure the government owns. They’ve pretty much entirely lost the ability to control the flow of information, and they’ve largely lost the ability to control its direction either with the fall of major news outlets.
I don’t think they have the support for a China-style great firewall, but I’m not British so maybe I’m wrong.
I think it’s a good thing information is set free, but I see why they tried it. It’s the only politically tenable way they had to try to keep that control.
I do also think it’s not as simple as “they should follow the process”. A lot of those people are refugees _directly because of the US_. We backed their governments military dictatorship in the Face of a democratic coup, resulting in years of brutal reprisals by security forces, eventually leading to El Salvador being the absolute clusterfuck it currently is.
The same vague story applies to several South and Central American countries.
We owe those people. It was a terrible thing to do, and has caused decades of suffering. I’m not sure if the solution is citizenship, but I don’t think we can just tell them to go fix it themselves.
Those are the parts the LLM is bad at. The 1% of stuff that was interesting was worth looking forward to.
I’m unconvinced about architecture mattering much. I used to think that, but these days I’m leaning towards it being the product of a problem we don’t have anymore. Architecture used to be dangerous and time-consuming to redo. If an AI can do that safely for $100 or $1000 in tokens (one day), that ROI is maybe negative
No one has managed to prevent pirates paying $10/month for seed boxes, and likewise they’re unlikely to succeed at preventing people renting minutes on an H200 located in a jurisdiction that doesn’t care about open models.
A bunch of tiny fly-by-night companies will bundle them with some management software into a subscription, and they’ll be too tiny and numerous to be worth dealing with when it takes an hour to set them back up.
Piracy in the torrenting sense hasn’t really ever come back, although it is as popular as ever if you count bootleg YouTube re-uploads, ripping music from YouTube, and the other non-traditional forms.
I suspect you’re right though. My fear is that systemic failure will happen too quickly for a reaction to the initial worsening. I worry we’re nearing a precipice where our debt will be unaffordable if our credit gets downgraded a couple decades in the future.
I had debated building something like this, and I really want to see what the other fork in the path looks like.
One of the core tenants of mine is to not impose a workflow or set of tooling on the user. I specifically opted not to go with k8s because access to local files is going to be a pain, and I think people will still expect that. There’s all sorts of “I need this binary that’s not in APT”, or “you need this cert to test, and we can’t commit it” stumbling blocks.
Yours feels like it’s pushing me into an unfamiliar workflow, but opinionated tools are often better so it’s worth a try.
My only direct criticism is that I think k8s is a bad way to go for this (but is probably what people expect). For personal use, k8s is more than I want to deal with. For work use, I suspect lambdas would be cheaper and avoid a ton of maintenance junk. We tend to think of agents as a persistent process, but they’re sort of not. They’re a stateless process that is effectively dead until a new message comes in, let it be dead until something else comes down the pipe.
Maybe that’ll be my weekend project, I’m sure no one has ever been mad to spend a weekend trying to parse bash.
It does have native tools, but they're also in plugins that aren't hot-reloaded. The LLM would have to write the tool, you close Pi and re-open it before it was available.
> Would you consider that a gap in security posturing?
Honestly, I think trying to secure the harness is a lost cause for the same reasons SELinux never really took off. They solve a real problem in a way so painful people would rather just live dangerously.
I actually wrote a thing to implement my security posture https://github.com/SethCurry/abyss TLDR it pretends to be an ACP agent, but runs the agent inside Docker (with optional bind mounts) and proxies the ACP connection into the container.
I'm also tinkering with WASM-based plugins in the ACP proxy to add some additional security and compliance posturing at the protocol layer (ie agnostic to what the underlying agent is). E.g. I slapped together a plugin that will automatically cancel a prompt mid-turn if an OpenRouter API token shows up in a) the prompt, b) agent output/thinking, c) agent tool calls. ([1], [2], [3]). The grand vision is slapping centralized management on that so security and compliance teams get a "firewall" of sorts to prevent leaking secrets, filter bash commands, censor PII, yada, yada.
1. Screenshot of it blocking something in Zed https://abyss.scurry.io/docs/guides/what-is-abyss/#i-am-not-... (I need to add buffering so it doesn't output any of the key)
2. Implementation of ^ https://github.com/SethCurry/abyss/blob/main/plugins/secrets...
3. Plugin architecture docs https://abyss.scurry.io/docs/guides/04-plugins/02-developing...
There is, for the same reasons that people use screen or tmux (which some people do use for this). If I were queueing a prompt I expected to take hours to finish, it would be nice to be able to run it another computer so I don't have to worry about closing my laptop lid or the battery dying.
It's not world-changing, but I have had agents do `grep -r /` commands before and it would have been nice to be able to detach and let it run rather than having to kill it because I have to leave before it'll actually finish (WSL is sooo slow on that). It would be better if the agent did a better grep, but sometimes I'd rather wait 20 minutes than spend 7 minutes setting it all back up again.
The suburbs were soul sucking to me, the people were largely insufferable. I knew my neighbors, but hated them because 90% of our conversations were some form of “I noticed your grass wasn’t cut this week” or “your cans sat on the curb until the morning”. There were some good ones, but like me they mostly hid in their back yard to avoid the Karen’s.