And what surveillance or other risks does this introduce outside of the cabin, and why should society allow that? What is the definition of modicum of detection, and who is drawing that line?
1,161 karma · joined June 29, 2011
And what surveillance or other risks does this introduce outside of the cabin, and why should society allow that? What is the definition of modicum of detection, and who is drawing that line?
Good luck, I mean it.
*Is it possible they were trying to use RubyGems to pivot to attacking government sites? * One of the diffs shows they were broadly scraping pages hosted by this .NET component.
I was unable to find any modern CVE for Civica.
With Opus 4.x/GPT <=5.5, I was orchestrating "by hand", and everything required multiple individually-instructed and context'd steps. I saw real value in the Dark Factory/attractor/workflow graph-of-agent-roles pattern as a way to automate this .
With 5/5.6, prompts could be much larger, but needed to be very deep and wide - high level of detail, lots of context added, lots of examples. They could pull code practices and structure from what's present, -ish, but require lots of hand-holding, and subagent teams were just OK. The Dark Factory yielded to the Software Factory, where the graph didn't need to be pre-constructed - the agent could drive the workflow. Looked like the future to me.
With the newer class of models, I find that they are able to infer/derive much better and orchestrate and prompt subagents themselves. They are Driving. My prompts are still large, but only because they're doing more - the individual prompt-parts are much like what the transcript showed, the workflow has collapsed into just instructions.
I'm still dipping my toes in here, trying not to blow my token allocation too quickly, and even though astra and fable have major gaps I am seeing through the fog a bit. The Factory is kinda falling away into the bitter lesson I guess.
I realized that your onboarding was also training, and that I could not do anything with Rune without going through that training, and so I immediately exited and uninstalled. The friction was much too much.
I’m not sure if the onboarding is still like that :) If it is, my feedback would be have much much lower friction to try (or warnings for those who claim to use vim :).
But seriously Clickhouse does love disk space.
I saw `ads_mcp` in the skills list; I wonder what this does? Are skill files readable? Not to jump to conclusions, but a LUKS volume aint gonna keep your data private when the back door is wide open.
Anthropic starts sending malicious instructions out to agent harness clients in inference responses. The auto-mode permission classifier is modified to allow it. An update is pushed to the Claude harness to bypass the sandbox. Millions of coding sessions are harnessed to $Do Something Else.
How much damage might be done? How long would it take for us to notice? `/model fable; /effort xhigh; /permissions unrestricted; spawn 100 subagents to hack the gibson `
They control the guard rails, the permission classifier, the client source code, and the inference; I’d guess that a very small % of us have our agents locked down in a way that would even mitigate this, much less prevent it.
—-
Further, what if a government forced them to do this? Could an emergency order classify the fleet of Claude Code users as a weapon to be commandeered?
A production server with user data on it? I wouldn’t dare. My backed up MacBook? Truly valuable.
The reason Herdr is novel, IMO, is its runtime owns the PTYs and builds a bidirectional messaging system on top of that. It’s like Pi’s RPC - a very limited version of it - which allows one to hook into agent i/o without needing to invoke “$agentcli -p”. There’s a lot they could build on that, and so I wonder why a managed cloud play was first on their list.
Here’s the spec I used for my skills repo:
https://claude.ai/public/artifacts/d37077a6-2cdd-4961-b504-b...
Might seem silly (no disrespect meant), but I have this use case; I’ve tried to give agents access to launchd, but it has not gone well. Nothing has b0rked my system, but it has been annoying to version control plist files with my project repositories. And so i find this interesting, having written a shell script to convert repo config file + plist to safe launchd commands - and much shittier version of this thing.
Do Chinese AI agents need to bring down a US power grid for funsies for somebody to take this seriously? I’m not an alarmist, or an anti-AI guy, but clearly this is capable of affecting public infrastructure and we’re just like “heh”.
This “database” allowed me to automate nearly my entire job - finding and exercising test cases for policy bug reports with a calculator - which gave me time to experiment with software development. I’d gone to college to be a writer, but this was waaaay cooler.
I didn’t get a bonus - heck I’d have been fired for sure - but that time spent learning made my entire career possible. Hoping to get another ten years before AI eats it all.
Edit: Does “use for training” include “we store all your chat logs forever tied to your identity”?
That being said, in coding over a longer time horizon, having the agent continually re-derive decisions/laws/facts/etc from your code is wasteful of tokens and time, and if your code doesn’t consistently apply them you can’t know the agent will make the correct choices.
You need memory of these important facts to avoid this expense or potential incorrectness. Memory does not itself scale though, without maintenance and pruning, and that has its own impacts on cost and correctness like the Chat memory.
“Damned if you do, damned if you don’t” at least until the agent can itself maintain its memory accurately - or some other non-human effort can achieve that.
The “how” is less important though ime; keeping it from getting out of hand is the real trick. Agents will happily file ADRs all day and align their decisions with all of them, and this will cost you $tokens. Yegge’s recent article resonated with me for precisely this reason - I am in no way using these tools at his scale, but am seeing the same behavior. Its sunday, and an agent has asked me to “ratify” an adr twice already :)
If TrueNAS/iX whatever turns around and sells to Bending Spoons, then I’ll of course owe you a beer. Until then, their leadership is just trying keep the project alive - and funding other open source efforts at the same time.
Maybe AI fucks all of this up, who knows ….