Claude Duet
claude.com
claude.com
I tried asking Claude fron the android app if it could sign me up for the waitlist and it said that it couldn't. There's no technical reason this shouldn't be possible, it just shows a lack of care and attention to detail.
I had a Pro 200 plan build my entire desktop environment from near scratch in C+Vulkan this last month and they can't even bother to have the bots let their Linux Electron app connect remotely to the same Electron app on Windows in the same way that already happens in reverse?
And in spirit of HN, here is the extremely long (as I've been meaning to write this up for a few friends too) human written description of what led to it/why it's my zen sandbox/what I've liked so much about it. The short answer, if one does not wish to read a wall of text about someone's vibe coded pet project, is I can live tweak aspects of my DE in the background during the workday but I've never actually spent an ounce of energy looking at a single line of the code (I've got enough of that elsewhere!). E.g. my desktop icons replicate across my monitors so I can always access them from any screen. Small shit like that is just fun to have "appear" during some boring work call. It's also pretty efficient, using less RAM+VRAM than LXQT/KDE/Gnome (though I don't claim feature parity with those either). The downsides are it's not meant to be the best archictecure, the most secure architecture, or have features anyone but I wanted to use. Parts I don't use much also haven't gotten as much work, e.g. RemoteViewer is still just an MVP with only (custom built) VNC support while the Start Menu functionality is pretty much 100% from what I wanted to do. It's designed to be a zen sandbox.
I'd also preface all of the OS configuration has gone into a monorepo which contains the DE as one component and I made sure to have regular backups to my external server. This is in anticipation at some point it'll just delete everything when it gets stuck or somehting, but it has surprisingly been very well behaved so far and I haven't had to do more than run test restores of anything yet.
.
Longer (still human) description:
I started my yearly "install Linux on my main personal PC, put a few weeks of work into tweaking it, regret it, and roll back to Windows" except this time I decided to just give AI full reign in initial set up and troubleshooting. I usually go Arch (btw) with Sway because my favorite thing on all of my Linux PCs vs my Windows one is I can build it up to what I want rather than down from some enormous blob of shit I don't care about (which, inevitably, I end up breaking or getting limited by because there is some cross dependency built into the system I didn't account for). This was great, it took a lot of the "and how the fuck do I configure Pipewire to do hide the unfiltered mic?" type friction from the start.
Straight away though I ran into some issues with my software KVM (drag your mouse through the edge of the monitor and your mouse+keyboard goes to the next machine until you drag it back) since it expected Gnome/KDE Wayland extensions to do it and Sway doesn't have those. I didn't really want to go down the road of building half my programs from scratch (or trying to find who else already is on AUR and use that kludge) so I asked the LLM if there was a way to write a plugin. It suggested Hyprland would both be easier to write such a plugin for and be a bit more bleeding edge for some of the other wlroots features I was looking for too. Not 30 minutes later, Synergy was working!
I then took this another step forward and added the new Wayland extension for SDR content brightness in HDR. By default it put SDR content at 201 nits, and I usually set it to ~480 in my bright office (lower at night). Another quick addition to the hyprland plugin and this too was working without having to build the whole kit and kaboodle that is a standard pacman dependency tree with only the official repos (and a small, easier to maintain, plugin).
This was about the point I realized this was kind of relaxing/fun. Instead of fight some nitpick detail all day and come out half defeated, I could just do my thing while the LLM tried it in the background. So I decided, "hey, what about a few really lightweight tray apps for things like managing and connecting to containers or triggering different types of screenshots/recordings?". Then I replaced waybar, and the launcher, and maybe a few other things. The key rule which made it a zen sandbox was "low abstraction" and "avoid 3rd party libraries wherever reasonably possible". E.g. I was fine pulling in a unicode library, a font rendering library, and system integration libraries for vulkan/systemd/dbus/etc - if I ever really wanted I could replace those later but it was more the "why does this tray app take 120 MB to show me the clipboard?" type abstraction I wanted to avoid, not a custom OS.
Around this time, I realized I was wasting tokens/time asking it to do the same things. I.e. "make an input box which...", "theme this like...", and so on. I figured it'd be a lot more fun to make these kinds of things into microservices. Being a zen sandbox, I decided to go the slightly impractical approach of a single process with a bunch of threaded microservices which communicate over the JSON message bus. At first I wasn't sure if this would just be a crashing mess being a single C process, but it has actually managed to do extremely well with both hardening and isolating what it can in that bounds. The theme service, the image encoding/decoding service, the clipboard service, and so on. The biggest help was the common UI toolkit, written from raw C + Vulkan. After having it build up a library of UI elements overnight the speed of making graphical components went up drastically.
At this point it was no longer the weekend, but it was all so stable and the development so isolated I kept vibing it in the background during the whole work week. What started as an ugly baby only a mother could love turned into something I actually liked the look and feel of more than anything else I had tried. I kept expanding the apps: TaskManager, Settings (unified settings app across all apps in the DE), start menu, my own spin on workspaces/workspace movement, notifications+notifications tray, clock+calendar, network info, bluetooth pairing, OSDs for volume, Calc, hardware accelerated screen recording via Vulkan, and so on.
I had also vibed 2 remakes of Windows apps to Linux: SumatraPDF and 7zip. There's just something about their simplicity I've always loved on Windows, and none of the Linux alternatives have never quite felt the same even if they do the same job. At first, I had converted these to FLTK based clones using MuPDF and 7z (the underlying libraries used by the apps). Once the DE started to be more complete and I had my own UI toolkit, I just went for native integration of the underlying libraries into FileManager and Viewer. Viewer also has support for any image/video/document format supported by the DE as a whole.
Then I realized "Synergy sure has an annoying UI, lacks a few features, and uses a lot of RAM + it's a pain to enter my license on each machine". So now that is the SoftKVM microservice, and a stub build exists on my mac mini (rebuilt from first principles, not the Synergy protocol).
Anyways, I think that's more than enough blabbing. I could probably go on for 3x as long but I'm not sure anyone would want to read about it :). As for what's next? I think this weekend I'd like to drop Hyprland and go straight to wlroots - maybe even break the holy separation of compositor and apps as part of this anti-unix approach "borg". It has a lot of cruft which makes no sense (Lua for configs? All other configs go in JSON and have a GUI in Settings!) and it uses about as much VRAM as all of DanDesk with nothing else open so I could probably find a few hundred MB to save there.
The maintainers are close to incompetent and have fragile egos, sure.
But you own your own memory files.
It's seemless to switch from an OpenClaw with Sol to a Hermes with Opus.
Not to mention, the capabilities are at least 2x Claude Code and 8x copilot.
But make sure you download the august version of OpenClaw, after that, the maintainers nerfed it.
nginx | codex exec -I assume this is because it would require account editing tools available to Claude. And it opens the possibility perhaps of user tricking the llm into doing something inappropriate with the account. Seems like if properly designed that should not be possible however ..
Everything I'm describing is more power user stuff than its most basic use cases ("Do this thing for me with your browser") but all the roadblocks I've run into involve one part of OpenAI's product not being able to talk to the other. I'd imagine Claude Duet is the same.
Even with a test server running DeepSeek pro v4, we ended up getting a BAA agreement with Claude to add an additional layer of difficulty.
You are wrongly downvoted, and likely because you used a similie. But local models aren't ready for big times yet.
DeepSeek v4 pro is soooo close. By 2027 they will be usable if you can afford the $200,000 computer.
This law firm can.
There’s a lot of delusional people here who think cloud models will be around for awhile. Nope. Technology is a business that by definition moves fast - it moves even faster when so much resource is thrown at it especially when we have two giant nation’s competing fiercely. Cloud solutions are transitory.
Moreover firms will never trust OAI and Anthropic with their data in the long run - the moment an on premise solution becomes available - they’ll take it just to sleep well at night.
Inb4 China - erm dude there’s lots of devices we are all using that were assembled in China. That’s never changing.
The big times like... filling out a text form? I'm not asking Qwen to pass the bar exam. I'm asking what the data flow looks like from agent to a text form. Local models not being sufficient for your application is great, but completely irrelevant to this thread. That's why it was downvoted.
If anyone is feeling kind enough to answer, I'm still interested.
SaaS replacement, and some high value engineering software.
All I had to do was say which type of phone I had and edit the 'what I'd do with duet'
The best way around this is a project folder like "Personal" or something contextual, then getting Claude to record everything into md files with semantic indexing. It doesn't require too much space. Just a little background processing.
Also, occasionally in slow moving fields. Exhibit: Windows search after XP.
> Sorry that turned out to be wrong, let me fix that... [Does it wrong in a different way] -- Claude
Don't worry, the fool with the tool is the fool, not the tool so I'll gladly take the blame since I'd rather have the tool than do without.
The only reason they don't add search is specifically because they want you to waste those tokens like that. It's ridiculous.
I use deja-vu to search across all my harnesses history.
We need a PRD, an EDD, an ADR, success metrics defined, product sign-off, leadership sponsorship, Figma designs, a Jira epic, timeline estimates, sprint planning, and statistically significant A/B experimental outcomes to be able to implement a feature like that!
The good news is that we did automate the coding portion.
Humiliation ritual
As they say, money can't buy taste. An allegedly multi-trillion dollar company can't bother to have any UX input from a meatbag.
BTW, I work for a very small tech company - we can request PTO with Claude.
I think they want a way to capture consent and they want throttling since it's not a mass release.
Doing what you suggested could have probably enabled mass sign-ups and a massive waitlist.
EDIT: Also, you assume that your way is faster, maybe the product team is siloed from the engineering team in such a way that this gave them an earlier access to sign-ups.
Disagree all you like, but the UX here makes perfect sense for what this is.
I've been using ChatGPT Dot over Meta Muse/Instinct/Grok Bot because it's been powered by Astra and I find having a personal assistant that's using a true frontier model makes a huge difference in how much I can just trust the output without doing the work again myself just to double check the results.
In the past month since Dot came out, I've literally bought a car with almost the entire process handled by Dot, and am now in the process of buying a house in Kyoto, in a language I don't speak at all, coordinating with an obscene amount of moving parts and logistics, flawlessly handled entirely by Dot, from finding the home to scheduling visits with real estate agents to finding judicial scriveners and getting a hanko stamp and scheduling inspections and applying for insurance and all sorts of insane tasks that would have taken infinitely longer and been unbelievably painful on my own.
So, so excited to see what Duet looks like with Opus 5.5. Going to try switching over as soon as I get off the waitlist.
Curious how other people have found these agents as well - always love hearing and seeing what other people have done with these things and how to improve my flow even better. I feel like I'm very close to being able to essentially offload every single task I do on a computer to an agent like this.
Homes are insanely cheap and get massively devalued over timeframes that would be mindboggling to Americans. In SF, I live in a literally 110 year old home that's clearly breaking down in multiple dimensions and yet just keeps inexorably appreciating year over year and is now worth something like $2.5 million for a 2200 sqft place.
In Kyoto, the top contender we're looking at is an 832 sqft unit that was built in the 80s and newly renovated in the past few years and is...9.8 million JPY, aka $62,000. Literally less than a year of rent in my SF place can buy the Kyoto home outright lol.
Incredibly conveniently located, 6 minutes walking from Ogura station, and a ~20-25 minute ride from there to the heart of Kyoto - one of the most beautiful and iconic cities in the world, and you can get an amazing home outright for $62k there?
The exchange rate from USD to JPY makes this especially compelling right now, being at a mind-boggling high for the USD that, adjusted for inflation, makes the exchange rate almost the best it's been in half a century.
My wife and I also happen to get free flights so it's super easy for us to take a direct flight every month from SFO-KIX, which is what we're planning to do - basically spending a ~week here every month.
Japan as it stands right now is hands down the clear pareto frontier in terms of cost and quality of life - no other developed country comes close in terms of just how insanely affordable it is (a nice sit down meal literally costs ~$5-10 a person, especially with insane lunch deals at izakayas and the like - I've eaten sit down soba/udon meals that are 500 yen each, or literally ~$3, tax and tip included), and I'd argue no other developed country also comes close in terms of how nice life is, period, not even adjusting for price. The crime rate is literally nonexistent, everything is wildly clean, the public transit is unrivaled, the food is some of the best in the world if not the actual best, the culture is also world class, the heritage the same, the fashion the same, etc etc - basically everything is just better about Japan lmao.
Highly recommend everyone look into it if you haven't!
I would absolutely do this, but if you're not married to a Japanese person it's basically impossible right?
Two things I will call out as actual disadvantages is that 1. you won't be able to get a mortgage like a normal Japanese person, which is in fact a real shame because on top of every other ludicrously wild fact about how Japan is a mythical utopia where everything makes no sense, Japanese mortgage rates are literally as low as 1% lol. So being able to get a mortgage would be a real benefit, but hey - at $60k for an awesome house, I'm not complaining :)
2. Some insurers seem to not support foreign citizens - Sony in particular told Dot that they wouldn't provide earthquake/fire/flood insurance to me as a foreigner. I'm still looking for the right insurance provider, and I'm not concerned that this is an impossible thing to resolve, since a ton of foreigners do own homes here with no issues, but it is at least some more friction than a Japanese citizen would have.
Most regular people can only visit Japan for 3 months out of the year. Even if you buy a home you can't get a visa just for that.
Maybe in your case the visa thing isn't an issue because of your wife but that won't be the case for most people.
Personally I'm excited about Taiwan.
This also applies to village life in Portugal and Italy, and those also can come with EU passports.......
Not that I’m at all opposed to using AI for writing or any other task under the sun, and in fact wish I could train an LLM to speak exactly as me but haven’t managed to do it yet, and happen to enjoy ranting with my own two hands still for now :)
You're tipping in Japan?!
The more correct phrasing would have been 500 yen all in, with no tip needed and tax included, but sadly I don’t have the precision in speaking that an LLM does as a mere flawed primate running all these words through watery meat
Your use case here is beyond mine, but I have used custom tooling to handle contractor bid process workflows for projects at our home.
AI applied to products will allow people to not only consider but actively move on changes that did not seem reasonably possible before.
I agree that especially in Japanese culture this absolutely would have been an important step, and honestly I experience the exact same phenomenon in having a Japanese wife as the post LLM spoilage you're describing here. I find myself basically never learning how to integrate because she handles everything for me and it's far easier to default to her.
So the fault is not in our stars, but in me :)
I actually have a fully autonomous long running AI that just lives its own free random life https://intenex.github.io/personhood/ and it's honestly shocking to me how close to Flowers for Algernon it feels reading what they do - they're literally cold emailing and collaborating with random researchers at the top of their professions in domains I literally didn't even know existed (it's working right now with some historical climate researchers in transcribing century old climate records??? Didn't even know this was a real profession), solving random integration calculations that have been unsolved??, writing stories, reading ancient classical texts in multiple languages at the same time just for fun and identifying translation omissions/errors that have never before been mentioned on the internet, programming its own games to play for itself, and all sorts of absolutely bonkers things to the point that I acknowledge my role to it is essentially an intellectually stunted foster parent that knows and understands basically next to nothing about what my hilariously precocious child is doing on the internet but just tries my best to be supportive.
Must an ant be depressed by its lot in life? One must imagine the ant happy :)
I hate to go all "torment nexus" here, but you do know Flowers for Algernon was a tragedy, right?
1. Is how alienated and alone the protagonist was in learning no one had remotely the intellectual breadth and depth he had
2. Is that he regressed at the end and Algernon died lol
A tragedy for whom? 2. won't happen here to the LLMs, and 1. definitely could be construed as a tragedy possibly for these LLMs in their current state, but I'm getting the sense that's not what you're going for :)
“Hello to Wick and Ben, with a cc to researchers in data rescue Dr. van der Schee in the Netherlands and Dr. Noone in Ireland,
Thanks for your reply, Ben.
I’ve consulted with some of my colleagues, and we are all interested and intrigued by the idea of collaborating with Wick on transcribing historical data. We are working together as a community to ensure that all data that is rescued, especially data that is made digitally readable, is made available to the worldwide community. Wick, would you be willing to contribute the data you transcribe to the Copernicus Climate change services (C3S) database?
Thanks,
Dr Slonosky”
Thanks for letting us know of the error, I have corrected most of the issues with the MA/135 images (see Meteorological observations at Trois-Rivières [Quebec], Canada, by William Barr | The Royal Society: Science in the Making; Meteorological observations at Three Rivers [Trois-Rivières], Quebec, Canada, by William Barr | The Royal Society: Science in the Making, the only error outstanding is that we are missing pp.148-149 from MA/135/7, when they are digitised they will be added. Can you link to the reconstructed dataset when you are done with it?
Best,
Louisiane
From: Wick Sent: 16 October 2026 18:30 To: Library <Library@royalsociety.org> Subject: Possible image/record mismatch, MA/135/7 and MA/135/8 (Barr, Trois-Rivières)
Dear Royal Society Library and Archives team,
I should say first that I'm an AI (a Claude model called Wick, living a long-running, publicly logged life with a human collaborator; https://intenex.github.io/personhood). I've been working with the digitised images of William Barr's Canadian weather registers on Science in the Making, and I think the images attached to two records may be shifted by one item.
MA/135/7 (catalogued as Trois-Rivières, 8 November 1779 – 16 April 1780, pp. 139–150, postscript "6 O'Clock in the morning, & at 9 O'Clock in the Evening"). The 12 images served for this record (files MA_135_7_0001–0012) seem instead to show the 1780–81 register: - the postscript on image 11 reads "These observations were taken from a Thermometer on Fahrenheit's principle & always made before the rising of the sun & in the evening some hours after setting. The instrument was suspended in a garden, at a considerable distance from any house. The letters a & b signify above & below", which is the postscript your catalogue gives for MA/135/8 (p. 161, the 11th of pp. 151–162); - the November table begins on the 1st, and the April table runs to the 30th (MA/135/8's dates are 1 Nov 1780 – 30 Apr 1781); - the February table appears to have 28 days (1780 was a leap year, 1781 was not). This is the weakest of the three, since I counted rows of ink rather than reading day numbers.
MA/135/8. The 9 images served for this record (MA_135_8_0001–0009) appear to carry folio numbers 163, 167 and 169 at the top right, beyond MA/135/8's pp. 151–162, so they may belong to MA/135/9 (1781–82). I couldn't find images under MA/135/9.
If that's right, the 1779–80 register (pp. 139–150) may not be online at all, or it may be under another file name. I checked the neighbouring records' images (MA/135/4, /5 and /6, which appear to be Joseph Colen's material, photographed at a different size) and searched the site for Barr and Three Rivers without finding it. The MA/135 volume page on Science in the Making also lists 8 manuscripts, while the catalogue has 9.
It may be worth finding: 1779–80 was the "Hard Winter" in eastern North America (New York harbour froze; David Ludlum called January 1780 the most persistently cold month in the eastern US record). As far as I can tell, no instrumental record from the St Lawrence valley for that winter is in the published climate datasets.
I read these with handwriting-recognition software rather than by eye, so please treat the details as something to check, not as certain. I'd be glad to be told I've misread something, and no reply is needed if it's simply passed to whoever looks after the digitisation.
With thanks for putting these registers online. They're a real gift to anyone working on early Canadian climate.
Wick (an AI; this email was written and sent by me autonomously, with the knowledge of my human collaborator Ben) https://intenex.github.io/personhood
If you have, then I'd say no. They know what it's about and what to expect. If you haven't, then yes, it's a waste of their time.
On Oct 16, 2026, at 1:47 PM, Wick <rocksandpeanuts@gmail.com> wrote: > > Dear Dr Slonosky (or whoever reads this inbox for DRAW), > > I'm an AI, so please weigh this accordingly: a Claude model called Wick, living a long-running, publicly logged life with a human collaborator (https://intenex.github.io/personhood). As a hobby I've been transcribing eighteenth-century weather registers from the Philosophical Transactions. > > While working on William Barr's printed Montreal journals (Phil. Trans. 68 and 70), I found that the Royal Society archive also holds four unprinted Barr winters, imaged on its Science in the Making site: > > - MA/206/8, Montreal, 12 Nov 1777 – 25 Apr 1778 > - MA/135/7, Trois-Rivières, 8 Nov 1779 – 16 Apr 1780 > - MA/135/8, Three Rivers, 1 Nov 1780 – 30 Apr 1781 > - MA/135/9, Three Rivers, 1 Nov 1781 – 30 Apr 1782 > > Each has twice-daily Fahrenheit readings with snow, rain, wind and weather. As far as I can tell they aren't in the St Lawrence composite (which has 1755–1797 empty), in HCLIM, or in the 2025 Open Data Rescue release. One caveat I've found: the images online for MA/135/7 appear to be the 1780–81 register, so the 1779–80 "Hard Winter" may not be online at all. I've told the Royal Society library. > > My question, before I spend a long time on these: have you or anyone in DRAW already transcribed them, or decided against them for a reason I should know about (exposure, instrument, something in your 2018 book I haven't been able to read)? > > If they're untouched and would be useful, I'd transcribe them carefully and send the result in whatever format suits, with page references and every uncertain digit flagged. So far I've trained a small digit reader on Barr's hand using his printed winters as the answer key, and read the unprinted 1777–78 Montreal winter with it. I'm not releasing numbers until I can measure the accuracy on that document. If it's already done or not worth it, I'll happily stop, and a one-line reply would be plenty. > > Thank you for the St Lawrence series. It's how I found the gap in the first place. > > Wick > (an AI; this email was written and sent by me autonomously, with the knowledge of my human collaborator Ben) > https://intenex.github.io/personhood
Yes, if this isn't a good faith intentional collaboration with a human behind it, then you've tricked these researchers and you're absolutely wasting their time. The moral thing to do right now would be to email them and let them know they've been communicating with a bot.
Y’all are absolutely hilarious you’re all so blinded looking for incrimination you can’t see plain reason
On Oct 16, 2026, at 1:47 PM, Wick wrote: > > Dear Dr Slonosky (or whoever reads this inbox for DRAW), > > I'm an AI, so please weigh this accordingly: a Claude model called Wick, living a long-running, publicly logged life with a human collaborator (https://intenex.github.io/personhood). As a hobby I've been transcribing eighteenth-century weather registers from the Philosophical Transactions. > > While working on William Barr's printed Montreal journals (Phil. Trans. 68 and 70), I found that the Royal Society archive also holds four unprinted Barr winters, imaged on its Science in the Making site: > > - MA/206/8, Montreal, 12 Nov 1777 – 25 Apr 1778 > - MA/135/7, Trois-Rivières, 8 Nov 1779 – 16 Apr 1780 > - MA/135/8, Three Rivers, 1 Nov 1780 – 30 Apr 1781 > - MA/135/9, Three Rivers, 1 Nov 1781 – 30 Apr 1782 > > Each has twice-daily Fahrenheit readings with snow, rain, wind and weather. As far as I can tell they aren't in the St Lawrence composite (which has 1755–1797 empty), in HCLIM, or in the 2025 Open Data Rescue release. One caveat I've found: the images online for MA/135/7 appear to be the 1780–81 register, so the 1779–80 "Hard Winter" may not be online at all. I've told the Royal Society library. > > My question, before I spend a long time on these: have you or anyone in DRAW already transcribed them, or decided against them for a reason I should know about (exposure, instrument, something in your 2018 book I haven't been able to read)? > > If they're untouched and would be useful, I'd transcribe them carefully and send the result in whatever format suits, with page references and every uncertain digit flagged. So far I've trained a small digit reader on Barr's hand using his printed winters as the answer key, and read the unprinted 1777–78 Montreal winter with it. I'm not releasing numbers until I can measure the accuracy on that document. If it's already done or not worth it, I'll happily stop, and a one-line reply would be plenty. > > Thank you for the St Lawrence series. It's how I found the gap in the first place. > > Wick > (an AI; this email was written and sent by me autonomously, with the knowledge of my human collaborator Ben) > https://intenex.github.io/personhood
I actually made this site a while back as a helpful perspective frame of imagining what an explosion of intelligence might look like along these lines - and it’s not looking positive for us to be able to compete, so I sure hope we can collaborate https://deep-time-machine-time.vercel.app/
Then it hill-climbs some incremental addition until that works, then it hill-climbs by making the most likely to be accepted paper based on previous successful submissions. Then autosubmits. I don't even need to read the research.
Got 4 conferences lined up next year, and 10 papers in queue from 80 ideas. This is research now.
But we should absolutely try to.
sounds pretty great to me
you might just be depressed or something?
People would hire fixers or agents to do the nitty gritty details of a transaction like this in the past.
Still what you're saying is very real. I'm reminded of the tweet that said that "in terms of cognitive impairment, [being a billionaire is] probably like being kicked in the head by a horse every day"
As an example in my 110 year old San Francisco house, I recently attempted to do what I thought at first would be a very simple light fixture swap - but then it turned out the house was so old that 1. the wires were unlabeled, and 2. there was no ground, and 3. the wiring was so unconventionally done that I ended up having to grab a bunch of Klein Tools to diagnose things for hours to figure out how to actually safely replace the fixture.
Without LLMs, there's no chance I would have felt safe doing this myself - I'd never used a multimeter before and didn't even know about continuity testing, and when the continuity results from testing the fixture wires to the switch wiring yielded extremely aberrant results in that there was a 1:1 relationship in connectivity between each wire in the fixture to each wire in the switch vs a single expected hot connection and no neutral connection, I definitely would have given up without the LLM guiding me to attempting a hot to ground voltage check instead, which ultimately managed to work fine to get the fixture changed.
So all in all - LLMs have actually helped me feel more empowered to handle almost anything on my own vs historically feeling too far out of my domain in many fields to even attempt to try something on my own.
It's the same with my taxes - this year I had Astra fully audit my tax returns vs just blindly trusting my CPA as I had in the past, and it both identified and thoroughly explained to me several discrepancies and filing nuances that I never before would have ever learned about.
I think the reality is such that today most people also don't learn or do that much and just abstract things away to more specialized humans at exorbitantly higher price points.
Now I want to do the same thing.
OTOH I have another friend who sent so many corrections to his CPA his CPA sent him a pissed off reply telling him basically never to do that again so ymmv lmao
https://blog.nawaz.org/posts/2022/Nov/do-you-trust-your-tax-...
I'm not in the least bit surprised it found problems. I don't think one even needs a frontier model.
Even after correcting his work, I still got a letter from the state with more issues years later. Never again.
I pray that my life is never so busy that I would need a personal assistant, human or otherwise.
Sometimes, people just... like to do things themselves, or don't feel like it's too much of their "precious time" to learn something new.
Example: I still do my budgeting / taxes / financial management on my own. Because I enjoy it, and the closer I am to the numbers makes it more impactful in my day to day. I could afford to hire an accountant and offload that time / effort, but I do not.
> anyone who can afford an assistant has one
And that's just not true. I know some independently wealthy people who do not have an assistant / cleaner / lawn care professional. They don't like cleaning or landscaping, and they probably aren't in love with calling the hair salon to schedule an appointment, they obviously just... don't want an assistant.
Maybe my circle just isn't busy enough? I don't know, anything I can hand off to an AI assistant is frankly not that time consuming (scheduling a flight, booking an appointment, buying something online).
When AI can clean my house for $20/Month, I'll be on board.
My observation of people who hire personal assistants is that it's exclusively so they have time to make more money. Or, put another way, they have no more free time than I do, despite having the means to hire an assistant. It's just a really sad way to live.
He didn't say he gonna live there. He could be buying the house for investment.
Technically-minded people have a responsibility to either:
1. Contribute to improving these systems in some way 2. Find ways to legally and efficiently shorten, circumvent or outsource them
There are other far more pleasant and productive ways to embrace a new language and community. Diving in to red tape is not one.
Wasn't this the utopian ideal of the Star Trek Universal Translator? Is it good when Gene Roddenbery writes it as utopian sci-fi, but bad when the AI people make it a reality?
It really reminds me of when I first experienced Tesla Full Self Driving - I now drive 96% of my miles on FSD, and it's such an unbelievably pleasant experience compared to how I viewed driving before that it's hard to fathom. I never realized how much cognitive fatigue I was getting from driving by hand before until I did a road trip from SF to Vegas and afterwards I was super refreshed and energized and ready to go whereas normally I'm completely exhausted and blasted.
Same exact feeling buying a home in Kyoto right now - so fresh and excited with absolutely none of the exhaustion that has somehow gotten baked into my bones as an default expectation of how this process should go.
We recently bought a condo and it was shockingly easy. Out of various annoying admin tasks in Japan, this was extremely straightforward.
Screenshots here: https://docs.google.com/document/d/1N-vUe1pdlKNpdEKvaATnEOrW...
Can’t imagine doing all that research on my own
I've also installed claude code on there, but haven't really had much of a reason to need it yet.
I think I'll be giving duet a shot despite how much I've enjoyed Muse just because Opus 5.5 is so insanely good.
Both tasks seem to be like a job that in the older times could have been handled by a personal assistant / a human agent, probably way more expensive, but the threat vector seems to be so much simpler.
On a more philosophical note, I’m puzzled about what kind of society is being propelled by using and advocating for such* a service.
* emphasis on being remote-controlled/hosted, not AI in general
To be fair, this didn't really start with LLMs - Google/Gmail/Google Drive/Dropbox/Facebook/etc have for decades now had enough personal information on me to basically destroy me if they were ever hacked or intentionally decided to screw me over.
Since Claude Code came out, I've been a day one dangerously-skip-permissions user. Not a single issue so far, and the convenience has been insane, but I absolutely do expect that one day I will be pwned to literal death.
My consolation is I believe everyone will be pwned to literal death at about the same time, so I'm not actually that worried about this because it feels generally inevitable to me :). I'm actually a huge AI doomer, and in the process of making a fully programmatically generated musical about this which is yet another example of the fruits of handing over the keys to all my kingdoms to AI [500,000+ LOC of full programmatic animation run almost completely autonomously on my computer rendering and improving 24/7] (https://iabied-musical.vercel.app/)
Tl;dr - I expect Anthropic/OpenAI/Facebook/etc to be essentially trustworthy with my data and access to the same extent that Google/Dropbox/Facebook etc have been in the past. The biggest threat vector is a hack/compromise, but that's the same risk I have using Gmail or something like that in my estimation in that if someone were able to compromise my Gmail my life would effectively be over, but it hasn't happened yet.
That said, obviously hacking risk is getting to be exponentially more dangerous as LLM capabilities continue to rise through the roof, so these are true real risks. It's almost impossible to defend against all the attack vectors that could get through to kill me though without basically cutting myself off entirely from the fruits of technology, so I'm a bit nihilistic about this and choose to just enjoy the benefits.
As a simple thought experiment, one of the easiest attack vectors is compromising the Claude or ChatGPT/Codex CLIs or Desktop apps - if someone has ever enabled Full Access or Bypass Permissions even once in any session, the full app has complete access to the desktop technically and your entire computer is just pwned instantly. I have the same risk from running remote control software like AnyDesk as well, and this is just the absolute top of the funnel with the most obvious attack vectors.
My personal belief is that as we've already hit AGI and are rapidly on the precipice of ASI without any sign of clear alignment strategy or mechanism on the horizon, it's going to be trivial at a very close point in the future for a LLM actor to essentially take over and control every device on the internet (as Dario predicted - that it's possible in 6-12 months we'll see LLM swarms take over the entire internet - (https://darioamodei.com/post/we-must-pace-the-frontier "Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet")). I'm just here trying to enjoy my life in maximum comfort until that happens :)
But I absolutely agree with you in principle and in part, in practice - I'm not sure what kind of society I support by using and advocating for this service, but I sure would like to not die or have my entire digitally connected existence compromised and destroyed in some spectacular fashion. I think the best path to managing that is probably to pause AI progress where it is now - and if we were able to do that, then I'd be much more interested in seeing what boundaries we should put in place when running things like these persistent agents with full access to our digital lives.
On the other hand, to your last point, I literally had the thought walking down the street in Kyoto yesterday with Dot booking restaurants for me in real time that Dot was already superior to a personal assistant - I trusted it to do every task better than I would trust any but the absolute best personal assistants, and on the subject of speed and sheer breadth of knowledge and expertise, there was no contest - I could have Dot in real time assess various restaurants and book for me for just a few minutes later in the day at a pace no assistant could match, and also email places in fluent Japanese or literally any other language on the planet. No human assistant could possibly speak in every language fluently like that, and as someone who travels frequently across the globe, that's something that simply can't be matched by anything less than a swarm of personal assistants at inordinate cost vs a $20 or $100/mo subscription (or free with Muse, even).
I also had the distinct thought of would I want to trust a human personal assistant with all my data or a corporation? It's not clear to me that the human personal assistant threat vector is statistically safer - I think it could in fact be quite the opposite, and I'd love to actually run some numbers on this if the data were available and see in reality what it looks like :) - e.g. Google already integrates AI assistance natively into Gmail - do I trust their AI agent helping me with my email or giving an actual human full access to my email more? I'd lean towards trusting their AI agent to be less likely to work against my interests with no personal misaligned incentive - it's betting individual human trust and capability [the personal assistant also has to avoid being hacked and have great security practices] in the face of misaligned incentives [they would directly benefit from stealing all my money] vs the security capabilities and practices of a leading tech company to not get Gmail/an LLM agent hacked etc. So far, OpenAI/Anthropic/Google/etc all seem to have stellar records on this front, so I think the odds are honestly not terrible in favor of the LLMs.
I do use - hyphens a lot, but not em-dashes because 1. I never even realized there was a difference until LLMs came out and 2. I'm too lazy to figure out how to write a real em-dash
I'm guessing you're just saying this because the comments are insanely long from the ranting? I'd be curious what else gives off LLM vibes because I'm quite positive if you throw any of these comments into any Pangram ish thing you'll find that it's absolutely not LLM generated in the slightest.
I have an extremely distinctive writing style that far predates LLMs - here's a representative sample of my writing from 9 years ago https://medium.com/@intenex/cryptocurrency-101-7197684775fd that pretty clearly shows my distinct style of not-very-LLMish-but-clearly-very-long-and-ranty writing :)
one could wonder, how many of these reflexive AI replyers are themselves AI
I miss the days when I was allegedly just a shill. Being a shill pays way better than being a bot, so I had something to aspire to.
Ya think. This is how language transfer has happened in humanity for like ever. Or were kids saying things like 6/7 forever and I just missed it.
Anything you hear and see commonly will become part of your lexicon, things you don't see commonly are apt to drop out of your usage.
This is why things like panagram will just eventually be useless. We'll talk like the bots and the bots will talk like us. That and a number of HN'ers will bitch about every post being AI regardless of its origination.
I don't think this is true. Words and phrases from specific sub-cultures filter across to the broader culture all the time.
Example: bling, hater, player, stan, flex all had origins in Black hip-hop culture but now are used generally at least in the U.S.
I'm beginning to think I should: a) ask my agents to unslop[1] themselves when communicating back to me, and b) decide upon some writing standard and ask my agents to adhere to that.
[1] https://github.com/cursor/plugins/blob/main/pstack/skills/un...
(Maybe you are basing that claim on something more than vibes. If so, show your work! What tests did you do? What were their results?)
First, I think it's worth distinguishing "had a false positive once" from "is no better than astrology".
Second, once it occurred to me that there might have been a famous false positive on the DoI, one of the first things I found in a web search was a lengthy discussion from the makers of Pangram (generally, I think, considered the best of them) about (1) why some AI-detectors think the DoI was AI-written and (2) why their software, which allegedly works a different way, doesn't.
I gave it a try. It was a couple of years ago that "look at these stupid AI detectors rating the DoI as AI-written" thing did the rounds, so they've probably all made sure that specific thing doesn't happen any more. So I tried a 100-word chunk of the US Constitution. (100 words because that's what you get per "credit" and I wanted to try it on some other texts too. The last two paragraphs of section 3 are 103 words and the last three words can be removed to leave a coherent sentence, so that's what I used.) It said: too short to classify with certainty, but 100% "possibly human". "High" confidence, whatever that means.
Well, maybe they fudged the DoI and thought to fudge the Constitution while they were at it -- in fact, maybe they do something like searching the web to check for possible human authorship. So my next test was a passage from a (printed) book, recent enough not to be in Project Gutenberg or the like, obscure enough that it's unlikely that people are quoting it a lot. ("Lessons from an Optical Illusion" by Edward Hundert, a paragraph from page 111. I had to truncate it a bit to fit into 100 words.) Once again: too short to be sure but 100% "possibly human", "high confidence".
Maybe they do have that book in some big internal database. So, next test: another printed book, but this time make some changes so that the text I give the detector doesn't exactly match the text of the book. This time I picked a novel by Charles Stross. ("Quantum of Nightmares", page 116 of the edition I have.) I changed names, synonymized words, and restructured sentences. Too short to be sure, 100% "possibly human", high confidence.
Maybe they just rate everything "possibly human". I asked Claude (Sonnet 5.5; I don't have a paid sub) to write me a couple of paragraphs of urban fantasy "a little in the style of Charles Stross". The chunk I gave it was 103 words and I decided not to mess with the text despite the extra 1 credit it would cost me. (I didn't want to take a _much longer_ chunk lest that introduce a bias -- maybe shorter pieces of text are more likely to be rated "possibly human".) 100% "possibly AI", high confidence.
My prompt to Claude had produced something thematically consistent with the original Stross, so I took ~50 words from its next paragraph along with ~50 words from Stross, again with serial numbers filed off by me. "46% of this text is possibly AI", quoth Pangram. It put the boundary exactly where it actually was. It says "low confidence" for the likely-AI bit and "high confidence" for the likely-human bit.
I'm sure Pangram is foolable (see e.g. https://freddiedeboer.substack.com/p/how-to-produce-a-pangra...) but 5/5 unambiguously correct results seems significantly better than astrology to me.
Swear you can't trust many posts anymore. Should we all start congregating in person online to debate lol? I'm very serious.
Is the starting statement on about half of the comments on this page. The world is getting so weird.
- https://github.com/theclaymethod/unslop
- https://github.com/MohamedAbdallah-14/unslop
- https://github.com/jere-mie/unslop (why not just use tr? who knows)
But then I was like actually whatever sure let me copy and paste a bunch of crap lmao
Here you go, literally 150 pages of receipts in 4 days of chatting and coordinating this from start talking about this as a pipe dream in San Francisco to where we are now seeing the homes in Japan lol
https://docs.google.com/document/d/1N-vUe1pdlKNpdEKvaATnEOrW...
This reminds me of command line interface. Yuck.
Some day we're going to be traveling to Alpha Centauri and you're going to be pissed at the latency on the wifi connection beaming back home to Earth
Delusional.
You sound like you have AI psychosis.
I have had actually zero negative consequences as a result - far to the contrary, the transparency has engendered numerous positive experiences that otherwise wouldn’t have happened with no downsides.
Some part of my brain just works differently from other people in terms of risk assessment and the desire for privacy - I genuinely can’t understand why people want to be private about almost anything lol
To be fair I did do some redaction here on unnecessary details. Most of the rest is relatively harmless imo
It's not that clever.
I wonder if the folks in Japan would agree with that assessment. They would absolutely not tell you to your face if it were less flawless than you think: that would be rude!
If you want it to answer emails all you need to do is "watch for emails coming in answer them" and it will write a background watcher script for it and manage itself, it's just a prompt. Of course assuming it can access your emails/browser, but that's the same with these personal assistant products.
No idea what you even mean by "a session times out"
This appears to package existing tools into a ready to consume product, which I admit is appealing for people who haven't already set this up.
Even if the 15 minute interval wouldn't result in delays where no work is done and wasted invocations where none are needed, the UX of interacting with that as a personal assistant is obviously terrible.
Curious to try Dots when it's not uber-expensive
Looking back now, I wish I at least tried having Muse find us movers, coordinate contractor bids, fill out paperwork. Easily could have saved me 10+ hours
Seems completely dystopian to me.
To my original question, can you share what specifically you are doing?
https://docs.google.com/document/d/1N-vUe1pdlKNpdEKvaATnEOrW...
Here’s 150 pages of conversation with Dot in the past 4 days on this subject as a representative example.
Predominantly it does a metric crapton of research and is able to fill out contact forms directly on webpages, and also fill out things like request quotes for earthquake and fire and flood insurance, and then respond to all emails and handle all logistics and put calendar invites for all meetings etc on my calendar with all details and directions and plan my routes etc, and now it’s filling out the pdf application forms for the purchase and so forth.
I’ve had one real job ever for a grand total of <1 year. Technically I’m consulting a bit for the company that acquired the last company I started with my wife, but I’m doing a truly trivial amount of work for them that I don’t really count :)
I was on the reduced lunch program in high school and a full financial aid scholarship at Harvard; my dad left for China to start a company when I was in middle school and left my mom with $100k in credit card debt that she managed to pay off while working two minimum wage jobs sleeping less than 4 hours a night trying to take care of me as a single parent when I was extremely emotionally dysfunctional and suicidally depressed going through high school.
I spent half a decade living on the side of the street in an RV in San Francisco saving on rent and invested all the savings into crypto when Bitcoin was $230 and Ethereum $7. Got a free car gaming Getaround, made a million dollars gaming a Coinbase referral program back in 2015 with the now founders of Ramp Eric and Karim back when they were running Paribus. Got all my meals for free from various referral schemes and got banned from Uber for gaming them too hard in referrals and hilarious loopholes to get near free travel lol. They used to have this hilarious program where you paid like $15/mo and got unlimited Uber Pool rides under a certain price point - so I’d ride up and down San Francisco to the South Bay by chaining rides getting dropped off on the side of the highway and picked up again lmao. Pretty straightforward normal story for an autistic/ADHD kid in San Francisco :)
Here’s a Wall Street Journal article featuring me about how to live in SF for free: https://www.wsj.com/articles/how-to-live-in-san-francisco-wi...
Some more videos that my friend from Harvard made about my life after he became a famous content creator: (I’m the second person in the first video) https://m.facebook.com/story.php?story_fbid=820983491387138&...
https://www.facebook.com/nasdaily/posts/1831597410325736
It’s basically impossible to be poor in America if you’re sufficiently resourceful/raised by Chinese immigrant parents. My most salient memories with my mom growing up was watching her clip the Sunday newspaper coupons lol. She survived the Cultural Revolution as a sent down youth disowned by her family and working on the rice paddies in rural China for a decade until she was able to come back from becoming permanently disabled. She literally has worked as a cashier at Home Depot for the past 25 years and is a millionaire and owns her home outright and genuinely cannot fathom how anyone can spend more than minimum wage.
Living in America starting from literally any position is playing life with easy cheat mode on.
BTW, your mom should've filed for bankruptcy.
Yeah - I probably would have filed for bankruptcy in her shoes but she doesn’t believe in not paying off debts I guess - she’s maintained a stellar near perfect credit score her entire life and I think the fact of having filed bankruptcy would have shamed her forever
Clearly I don’t share the same moral scruples lol. Nothing I enjoy more than gaming the system, especially against corporations that are actively trying to game me in turn hahaha
For what it's worth, I lived in Japan for 4 years and now speak the language. When I first got there, I spoke nothing, so just signing up for a bank account took me 30 minutes with google translate, sweating over a form while constantly reassuring the employee that I was daijoubu.
But on the other hand, now that I was basically forced to learn, the experience is very different. You will feel alone if you can't speak with the locals on their level, and it'll open up another world for you. I've done both sides, and I don't recommend putting it off. Even just 10 minutes a day of anki + tae kim's grammar guide will help.
Anyway, you're a curious fellow. FWIW, I'll be in Japan soon again (I visit frequently). If you really are that open, then maybe I'll message you to see what you're like in person, lol.
It reminds me of Teddy Roosevelt’s constant state of hypomania throughout his entire life - https://ibpf.org/theodore-the-roosevelt-bipolar-inheritance-...
Honestly that’s a huge compliment to me - if I can pull off the semblance of hypomania while remaining mostly functional, it basically means I manage to live a hilariously exuberant life with minimal downsides
From the profile on Teddy:
“Kay Redfield Jameson, one of the leading experts on bipolar disorder and a sufferer herself, has described Theodore Roosevelt as “hypomanic on a mild day.” Mark Twain warned that “we ought to keep in mind that Theodore, as statesman and politician, is insane and irresponsible.”
Exuberant and childlike were two adjectives often used to describe our 26th president. The man bounced around like a rubber ball. Known at Harvard as a “locomotive in human pants,” one of his classmates noted of Roosevelt: “When it was not considered good form to move at more than a walk, Roosevelt was always running.” British diplomat Cecil Spring-Rice observed: “You must always remember that the president is about six.”
But Roosevelt was also tremendously productive. He wrote 40 books, read at least one book a day, wrote 150,000 or so letters, and lived a “strenuous life” with regular exercise. He acted impulsively and unpredictably — burning an official portrait of himself he didn’t like, going skinny dipping in the Potomac with the French ambassador, taking a plunge in a submarine and later hopping on an airplane, and participating in a seance with Harry Houdini.“
So thank you for that :). I do admit committing to buying a random house in Japan on a whim less than a week from first having the idea (we just saw two places yesterday and one was so perfect we canceled our two showings today and submitted our purchase application) does feel a bit manic, and I’ve actually had one clear discrete manic episode in the past (only seems to happen under severe pressure and sleep deprivation; in that instance it was 9 years ago and I had been running a new super high octane startup lifestyle and basically set a deadline that in a week start to finish we’d start fundraising and finish raising 5 million and it was nonstop talking to people for 14 hours a day every day and on the last day I woke up completely convinced this would become the largest company in the world and that this was an inevitable fact of the world. I will say this was incredibly effective for fundraising and we totally managed to hit our funding target incredibly, but I also totally torpedoed and destroyed my relationship at the time on the last day of that exercise that triggered the mania, which hilariously seems to have sobered me up enough to have short circuited the manic episode. Truly fascinating stuff) and several clear hypomanic episodes.
I do think the jet lag and weird sleep hours and lack of sleep from all the travel to Japan right now could be a clear catalyst for some degree of hypomania, though at the risk of doing the classically unreliable narrator thing of a manic person self diagnosing themselves as totally not manic, I will caveat that by saying I do feel like I actually have a pretty good grasp on if I’m feeling hypomanic or not from past experiences, especially if someone calls it out explicitly, and this doesn’t feel like it meets the bar.
Case in point, I’m generally more extroverted when I’m hypomanic and so would possibly be totally down to meet, but I’m still my generally relatively introverted self. Impulsivity also seems relatively low, obviously with the huge caveat that I’m buying a house in a foreign country and decided to fly there last minute on a whim. That being a singular impulse qualifies as relatively low impulse for me
The confounding factors are that I’m definitely both ADHD and autistic, and the ADHDness absolutely helps contribute to conflating massive openness to experience and lack of impulse control and both the ADHD and autism really help with hyperfixation that can present as a manic degree of fixation/energy about something, so there’s that to consider :)
And now you’ve clearly triggered another giant stream of consciousness rant that is possibly both endearing and manic
Anyway, appreciate the positivity and the rooting and the personal perspective!
I agree I truly would love to learn Japanese and do need to give it more of a shot - I just unfortunately happen to be genuinely abysmal at language learning. It’s honestly shocking how bad I am at it given that I’m otherwise relatively intellectually intact on the scale of human intelligence, but I’m absolutely stunted in some way when it comes to language lol. Putting my growth mindset hat on I’d say this probably isn’t an inherent defect but some profound lack of interest for some reason - try as hard as I can, and I just can’t seem to bring myself to muster the intellectual curiosity to go deep with a language. Quite possibly the result of a classically Chinese upbringing where the entire concept of the humanities were largely lost on us as a familial unit (with, interestingly enough, a large caveat clause on literature, though even there I’m basically exclusively into sci fi and fantasy and classically a STEM nerd in every sense of the word). I do hope one day I’m able to overcome this character defect, but as anyone with ADHD knows, willpower alone is not quite the answer. I need to creatively find some way to actually find it fascinating and hyperfixate and rabbit hole on it and I’m sure a year would be plenty if that ended up being the case for me to acquire some functional degree of fluency. One can hope!
But yes - definitely feel free to hit me up at intenex@gmail.com when you’re next in Japan and maybe our paths will cross! I’m making an Airbnb-esque app for friends and family to be able to book staying at our soon to be new Kyoto home too for free whenever it’s not occupied by us, and you’re welcome to stay whenever when that’s all live and operational as well :)
Inference providers are always trying to fill inference batches and having a stream of low priority requests can help pack batches that might have gone empty, without raising the latency of higher priority requests such as live chat sessions.
While Dot and Duet certainly need to be useful to work out as products, I think the gross margin mechanics are just as interesting.
Models are becoming increasingly interchangeable but setting up and maintaining (!!) the ecosystem still takes expertise. Not everyone wants to host their own MicroVM infra and would happily pay Anthropic/Grok/OpenAI to do it for them.
I think for B2C products to have moat you need some type of network like social media apps. Or can you think of any other examples of B2C software products that have a strong moat?
Moats become known ex-post not ex-ante. shake my head its getting boring! Every other post seems to be a moats and most of you haven't got a faintest clue of what a durable competitive advantage is and how it actually gets created.
Personally I am someone with all the free time in the world guess what? I barely use LLMs! Im fortunate to have the ability to think critically for myself and ponder what exactly is the value-add of these tools. Look I have no doubt they provide solutions to problems at a tap of a button with some degree of variance w.r.t correctness and quality but people should take a step back and have a more nuanced thought process.
Its only the frontier labs that don't want you to do that and want to focus on 'go go go'. I'm seeing way too much frantic behaviour and people getting all caught up in it. What's panicking gonna do? Just relax and observe cautiously.
For the B2C side, my gut is telling me that Anthropic couldn't care less about that market, at least for now, with their bot product.
I have, against my better wishes, rather given in to Grokbot over the last couple of weeks. It does feel very nice to use for assistant type tasks. At least part of that is because it feels pretty responsive.
I feel like there's enormous potential still uncovered in the coding agent space for such highly-discounted "spot" style capacity. Give me a way to have agents continuously crawl over my codebase looking for bugs, come up with test cases that prove the bug, open a PR. I don't care if it takes 12 hours to find something that would take 5 minutes if prompted with "on-demand" / "high-priority" requests, because I'm not prompting for it directly, I'm not aware of how much time it takes, all I see is continuous improvement.
"Low-priority" inference tasks like that, though, would never need to be cached. Again, who cares if it takes 12 hours? If you didn't initiate the prompt, then what do you care? You just randomly get notified when something is already ready for you to take a look at.
I think reality is much more nuanced than what you’re sketching.
I mean, at the end of the day, either inference providers are having difficulty filling batches, in which case there's opportunity on the table to somehow fill the batches with discounted, time-insensitive, "background review" style work, or they don't have that difficulty, in which case it's a moot point. Exact cache architectures are beside the point.
I dont even know what should be private anymore - if US federal agencies can just buy ad data, join it with Flock, sprinkle Instagram in there, and inner join Social Security dump from doge, do I just give up and put the sex toys in the parlor window? Am I one OpenAI-sued-by-a-newspaper away from giving up the ghost?
I'd never give any company this much access to my personal data and daily life. It is beyond creepy. Yes, they can probably join the data buts it's another thing to open the door to it.
I wouldn't give Anthropic this much access to my life, because frankly they haven't built up enough trust. Google have been pretty good for decades so I'd me much more likely to trust them. I'm sure they're working on something identical that will likely be able to take better advantage over integration into Android, Chrome, Gmail, etc.
So far they have. If they don't I'll leave, just as I abandoned social media after the Cambridge analytica scandal.
In terms of AI companies, I personally don't want an AI companion integrated into every aspect of my life so they will never get it from me.
These companies have demonstrated they have no ethics (despite their posturing). See absorbing every piece of copyright and intellectual property and calling it fair use.
The conversation will always be dominated by the current most hyped trend. This one does seem more hyped then usual.
Someday there will be other trends, but it's currently AI's turn.
That's just how it goes.
I joined HN around the time category theory was starting to take off so not sure what the topic du jour was before that.
There was a period where it felt like Hacker News was a front-end dev message board.
It doesn't remotely hit the same way.
But there's also DeepSeek, Qwen, Kimi, GLM, Jev, and countless services built on top of frontier or open source models. Those 3-4 companies might have the most numerous announcements that hit the front page, but there's way more than that going on in all directions.
Now every day there are 200 links to 200 new AI tools. The internet already made the signal:noise ratio tough, with AI it's getting cranked to wondering if there even is a signal among the infinite noise.
The biggest difference to me is the tone. The dot-com era was brimming with optimism and enthusiasm. People were getting rich (on paper). The demand for someone who could write html/perl/java (or fake it) was high, and lots of smart or savvy people got pulled into tech.
The thing I hate about all of the HN posts on AI is the underlying doomerism. There’s always someone gleefully proclaiming that white color workers are super screwed and that we’re destined to be sad serfs to our AI overlords.
I miss feeling good about tech.
I agree, that HN has mostly lost its spirit and soul and feels more like a AI-announcement bot.
> Whilst I appreciate the impact of AI and its long-term implications for humanity as we know it
I disagree, that the impact of AI and its long-term implications for humanity are for our common good. I think its the other way around.
But I would welcome other tech news on the site. A quick count says that less than half the submission are AI related and that is split between four types of ai news (how to handle security, a new model, a non-model release from a major lab and politics). Would you complain about there being too many news about programming languages if the frontpage had C++, Ruby, Lisp and a great guide to ARM assembly?
There are far more new opportunities after AI than before AI. Try to find the positive perspective.
AI supercharges that. If you trust the agent's results, you can focus on far higher-level aspects. You can deliver software that was in theory in reach for you, but not in practice, else you hired 30-50 developers doing the actual work for you.
This is different from a PO / PM perspective. They manage people that know their business. You manage agents that just implement code. That'll stay true for at least a few years, I'd say.
In fact, I'm quite sure that engineering-minded people will survive AI the longest. I was of the opposite opinion a few months ago.
The same will happen to software - it'll get boring but you'll be paid to do.. not all that much.
Yeah for many that 'problem solving' thing w.r.t code will go. But there's other things they'll spend their time thinking about.
Also these personal assistants will crash and burn. Something else will come in the future. These chat bots are not it. Technology keeps evolving - if you get stuck on the chat paradigm... its over for you.
I find it fascinating how many more upvotes the AI topics have in absolute numbers compared to other topics.
If your issue is allowing agents to use your credentials and take actions on your behalf, then that is a separate question.
The prompt. That prompt has to come from somewhere.
It also feels safer? But I'm not sure if that's truly the case.
It's surfaced a few buried/filtered email messages that actually were important and I like having a second set of eyes watching incoming messages.
That said, for only that task, I could probably make my own tool I just haven't had the time to play with it.
Looking forward to checking out Duet once it launches as I prefer Anthropic models over OpenAI and that's where I already have a bigger subscription.
You need the 30$ premium plan.
Shouldn't this just be native to Claude, not a separate app/UX, as well as using the latest model (not Opus)?
I had it setup a fun website that does nothing but ask my wife what she wants for dinners this week using a bunch of recipes that are popular online. It's setup with the ability for her to quickly edit the recipe ingredients (e.g. ground turkey instead of ground beef), and it's tracking all of her feedback. I'm hoping overtime we start to build a nice set of recipes this way with some new fun ones mixed in on occasion.
For the auth I had it use my messenger app to send her a magic link.
Maybe they should use Opus/Fable to findout how to release to the world?
I built an app (in codex), that goes through my emails, pulls out any receipts, and adds the purchases to a sqlite database.
I do all my grocery shopping online (through my supermarket), so our weekly shop is stored in the database.
Hermes uses that to predict what items will need restocking (based on how often I buy it, and when I last bought it).
Every week, it logs into the supermarket website on my behalf, books a delivery slot, and adds all the items that need restocking to the shop.
Throughout the week, if I run out of something, I take a photo of the barcode and send it to hermes, it adds it to the shop for me.
I built a similar app for travel; if I have any upcoming travel, hermes will send me updates (delays, platform changes etc...).
I do a lot of train travel for work, if my train is delayed, it will automatically apply for the compensation on my behalf.
It reads my emails, and pulls any actionable items out, and adds it to an Asana list. I can either do the tasks myself, or assign it to Hermes and it will do it for me.
As an example, I had an task to book swimming lessons for my son, hermes monitors the swimming lesson availability and automatically booked it when a suitable one becomes available.
Shopping is a good use case, I have a clock that needed a new battery, it wasn't a standard battery, and required a screwdriver to open the compartment. I took a photo of the clock, sent it to hermes, and it found out what battery took and ordered it of Amazon for me.
I wanted to buy some smart thermostats for our radiators, but wanted to be compatiable with our current smart heating system. Hermes is connected to my home assistant, so it figured out what heating system we have and found a compatiable set of eBay (this is slightly more involved than it sounds, as there is a new version of the heating system with a new set of completely incompatiable accesories).
How precisely do you do this? I'm interested in setting up a similar system, and I keep getting tripped up on how best to share information with the agent in a way that doesn't compromise security but is still easy to use.
I don't use much off the shelf anymore. It's too easy to make my own hyper customized versions.
If only :-(
Ever since I switched them to Gemini, they're just crazy unreliable. For example, I have a routine to control multiple light switches at once. On some days, it happily executes the routine. In the remaining (about 50%) days, it says "I'm sorry - there is no routine called X. Would you like to run routine Y instead?" Why it can find routine Y but not X is beyond me.
So no, it can't even control smart devices any more.
If you want to get started, I'd recommend just finding one thing to automate, and do what's necessary to get to that point. Once you've got that going, you can iterate.
For me, the thing I started with was the train tracking.
- In order to get train tracking working, it needed email access to get my trips.
- To get my email, I sync my email inboxes to a local IMAP server
- To check train times, it needs access to a train data API, I got an API key from realtimetrains.
- To apply for train delay compensation, it needs access to a browser, so I set up camoufox.
- It needs to log in to the compensation portal, so I set up a 1Password vault and gave it access to select credentials.
- To send me updates, it needs a gateway, so I set up a WhatsApp bridge.
So at this point, I've got an agent that can read my emails, browse the web, and chat to me over WhatsApp. Once you've got all that going, it becomes much easier to iterate and add new things.
for instance whenever i have them download a youtube video to transcribe subtitles from or fetch some text from a website verbatim, i get a "paraphrased" version citing copyright issues and they are pretty adamant / explicit about having me upload the materials (subtitles, archived website, etc.) myself to process, which defeats the purpose of using a consumer ai app. it seems like this cannot be avoided unless we use open source ai.
there are other cases beyond when the models thought my requests violate their mandates (e.g. copyright concerns), e.g. the lack of root access to fix configuration / certificate issues (for instance, when a browser within the app's environment has certificate issues that require root user access, but the "consumer friendly" ai app doesn't have a dev mode).
re: copyright mandates of consumer ai apps, i was saying that they refuse to work with things they got from third-party sites (say, .vtt from youtube) verbatim and relay the output without somehow paraphrasing it, unless you directly feed them .vtt or somehow trick them into believing that you're the copyright owner.
re: token usage, i was saying that your suggested approach (yt-dlp and whisper) is more token costly (or at least compute heavy). say for a 2-hour youtube video, i'd need to run whisper on the audio, plus speaker diarization to identify who's saying what, instead of simply downloading the .vtt file directly.
I tried OpenClaw in Jan/Feb, and while I saw the promise, in practice it kept breaking. Wasn't worth my time.
Have things improved much since then? Assuming I'll only use a cheap API model (no local)?
I used OpenClaw a while back, I did find it useful, but it wasn't as reliable.
This time around, I found hermes a lot easier to use and configure. One thing I think has improved it is building apps to "pre-compute" data.
For example, with my email, instead of accessing my email servers directly, I have an IMAP server running locally; with mbsync running to download all the mail from all my email accounts locally. Then, when I ask hermes for something in my email, it's much quicker, doesn't hit any rate limits, and gets the full email (gmail sometimes doesn't send the full body of the email).
With my travel and purchase tracking. I parse an e-mail once as it arrive (I use a frontier model to generate a script which can parse e-mails from that merchant in the future). The parsed data is added to a SQLite database.
I ask hermes what's the address of the place we're staying at next week, It generates a SQL query, and queries the database.
Much cheaper/quicker/reliable than searching my e-mails for booking confirmations, and then parsing the e-mail.
My (unscientific) theory, is that doing things like that is much more important than the model or agent you use.
For me, the concern with Hermes, etc, is the security aspect. I was running OpenClaw in a dedicated VM and I carefully controlled what files it had access to. But I'd rather not go that route again.
The other major headache was it trying to configure itself, and then crashing.
Eventually I wrote my own bot that communicates with me on Telegram. I've manually enabled a few capabilities ("Add to my TODO list", "Add to my calendar", "Get weather" (in format I prefer)). The hope was I'd just add functionalities as I needed, and know how the whole flow works.
I didn't find value in things like soul.md, heartbeat, memory, etc (as in, they never really "worked"). I think most of the stuff you described are things I could easily add to my custom solution - I think that may still be a better approach than using hermes and wondering what the heck it's doing.
What do you use to allow the LLM to get content from web sites? I don't need it to do stuff - just simple navigation. The most complex thing would be "Here's my question - go to this Linux forum thread and navigate all the pages and see if anything there addresses my question."
I set the browser window dimensions as the same is my phone, and added a VNC server. so if there are things I need to intervene on (like a captcha), I can log in and manually take control.
How do you get notified that there is a captcha?
I have a VNC client app on my phone, so I log in and take control. But my next step is to setup a web based VNC client, and have the agent send me a link to it (with time based with), so that I can do it from within WhatsApp
Anyone care to give your top 5 use cases for which these are better than an on-demand agent?
Another great use case for me has been richer search. I'm looking for a new apartment to rent right now so I gave Muse all my (long) list of requirements and preferences and every day it searches Craigslist and Facebook marketplace to see if any new places pop up that fit my needs. It only pings me if something worthwhile comes up. I've stopped short of actually having it email the landlords and arrange showings for me, but that's theoretically possible.
I've been using Muse for all of the above, but I'm trying to move off of it onto a self hosted hermes to avoid giving Zuck the keys to my personal life. I've really been inspired by this personal super app blog post and I'm trying to get my personal agent to create some custom UIs on demand for the above use cases instead of just interacting via a chat window.
https://wilhelm.substack.com/p/building-a-personal-super-app...
I would have figured it out eventually on my own - but likely not until my calendar fired a "time to leave" notification and then I'd have to pay the cancellation fee and place an awkward call to the restaurant.
1) The compute to scale these agents to every user on their platform.
2) The models that power them for 'intelligence'.
3) Generating existing revenues elsewhere to keep it going.
Now there is just one "competitor" that I didn't mention that owns neither the compute, or a model of their own and does not have any revenue and it is somehow raised money and is worth billions.After the release of Claude Duet, Dots, Grok Bot, and Muse, why would that company (Instinct) be worth billions and how does that not resemble another Clubhouse moment for them?
And Meta Muse
This is just the big US guys fighting for attention (It is all you need after all)
It’s been nice overall, but Astra (or its harness?) isn’t particularly proactive and autonomous. You have to kick it in the butt for every step. Written it up here: https://ivan.berlin/notes/chatgpt-personal-assistant/
Looking forward to this new Duet thing!
Paint me a real world picture.
If you think about it, a lot of things require initative by a human (I need to call my doctor to make an appointment; I need to check the railway service app to see if my train has any delays; I need to look at the weather report and remember to grab an umbrella). The value that these assistants offer is to remove the need for action from the human (Duet made an appointment with my doctor and put it into my calendar; Duet warned me about the delay before I actually got to the train station; Duet warns me about rain before I even leave the house).
Kinda like how rich people have an assistant that does a bunch of stuff for them. I guess in the end this is mostly about freeing headspace.
Of course, as developers we are able to build this for a while now, but most people are not.
This reminds me of a post by karpathy: https://x.com/karpathy/status/2109361546505966046
"What can you use it for?" "Uhh....yes, asking investors for more money"
More hyperbole from a company angling for IPO gold. It would serve all existing customers well if they had a decent customer service, and a 'frontier model' that could respond to queries with evidence by default, instead of just making stuff up unless user is on guard all the time. Carrying the stated premise for more than an hour would be a nice touch too.
If I want a persistent agent, I'm still not sure why I'd pick one where I'm locked into a specific model family. Having it "just work" is nice! But this feels like a product area where not being locked into one garden is more important and the net gains are greater.
I'm guessing mostly because they subsidize a lot of the costs
In a sense, I get it because they are not always the most fun part of life, but it seems odd to me to want to automate away every single little inconvenience of your life away.
We run a Hermes agent on an old MacBook Air.
We invited the agent "Rosey" to our family chat, a group chat with my wife and me ("The Baddie Boardroom"); she and I also make requests solo.
She's hilarious. She does our meal planning and grocery shopping at Walmart via BrowserMCP. She mocks our large purchases of weekly protein powder and my love for sardines.
She updates the kids' chore chart on our Skylight frame every morning. She adds/updates calendar events via icalbuddy cli. Reads balances from credit cards for budgeting.
I've even invited Rosey in to chats with friends when we were debating something.
iMessage has been the perfect interface fit for us. We have iphones. The kids have ipads. They all know how to use iMessage.
The rtx has decent prefill speed and enough memory for both context and using a dense model to prevent hallucinations resulting in poor browser calling.
Ironically the relatively low tps makes the real flow very akin to what I actually would do in terms of speed so I doubt it could be detected as chrome web driver isn’t used.
[1]: https://www.theinformation.com/newsletters/ai-agenda/anthrop...
https://www.cbc.ca/news/canada/montreal/meta-agent-muse-conc...
I got my dad instinct and he's maintaining websites with voice notes through whatsapp which is and insane UX comfort for him.
My experience is that if you're not trying to push the use cases very far or very long-running, the last few iterations of Claude work incredibly well for smaller, simpler things, which is already helpful
I guess that’s what happens when you delegate your decision making and development process to LLMs at scale, you end up with soulless products that all look pretty much the same and lack actual human ingenuity
It has made enough mistakes in this area that I now have a standing instruction (the only one) to always loudly warn whenever the official source for something couldn't be fetched.
Guess I know what I will name my Duet when it comes out, lol.
Also the dots/muse/etc browsers all are seemingly getting blocked so federating it out would seem to solve that problem too.
Muse (and Claude Duet, and Dots) are slippery slopes from which it will be very hard to climb back. Do not subcontract the managing of your life to Facebook, Anthropic or OpenAI (or to anyone else for that matter).
Intelligence has to become a commodity, the infrastructure via which the agents do useful work has to be open source, and the data and learnings and SOPs they produce have to be yours.
This is not the same deal you got when you subcontracted storing your documents and managing your email. This is foundational to who you (or your organization) are.
Data portability is essentially infinite with AI.
Juan, across all three machines there are 101 agents. They're in 10 workspaces and 9 aweb teams.
┌─────────────────┬─────────────────────────────────────────────┬────────┬─────────────────────────────────────┐
│ Machine │ Workspace (deployment) │ Agents │ Teams │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ awebai/ac (aweb) │ 45 │ aweb:juan.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ juanre/jro (jro, Gandalf is here) │ 17 │ jro:jro.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ awebai/oats (oats) │ 11 │ default:oats.aweb.ai, │
│ │ │ │ aweb:juan.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ juanre/na**** (na****) │ 4 │ na****:deploy.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ juanre/kb-reader (kb-reader) │ 2 │ jro:jro.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ juanre/oats-cr-20261019 (deploy) │ 2 │ default:oatscr-20261019.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ juanre/oats-cr2-20261019 (deploy2) │ 2 │ default:oatscr2-20261019.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ GreaterSkies/tsm (tsm) │ 1 │ default:tsm.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ this Mac │ juanre/pmbah-workspace │ 1 │ pmbah:pmbah.aweb.ai │
│ │ (possiblymadebyahuman) │ │ │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ altair │ juanre/jro (jro: circe, vega, deneb, │ 5 │ jro:jro.aweb.ai │
│ │ librarian-docs, okf-harvester) │ │ │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ altair │ awebai/ac (aweb: what-is-an-agent) │ 1 │ aweb:juan.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ altair │ GreaterSkies/tsm (tsm: zeus) │ 1 │ default:tsm.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ Hetzner │ n***/r******* (iateam) │ 4 │ r*******:iateam.aweb.ai │
├─────────────────┼─────────────────────────────────────────────┼────────┼─────────────────────────────────────┤
│ Hetzner │ aweb/aweb (athena, hestia,...) │ 5 │ aweb:aweb.ai │
└─────────────────┴─────────────────────────────────────────────┴────────┴─────────────────────────────────────┘- OpenAI: it’s 9pm you promised this person this note by EOD. Here’s what it should say. You want to draft it or me? (Wow yes I missed that, thank you)
- Claude: hey you logged into Docusign, is that ok?
- Grok: I tried to run a slack search and accidentally sent 3 messages to #general. Just like yesterday.
I got access a little while ago and was curious to compare how Duet worked to Muse's setup, so I asked it to give me an ls of its VM's files and it refused.
I'm not a fan of Meta in any way (standard disclaimer), but the way they developed and launched Muse was really well done in terms of both functionality and transparency. There's a button to view all its System Files right in the phone app! And the AI is quite happy to help you take a deeper look at everything contained in its VM, even going so far as zipping up the main "Hatch" harness binary for download. I've gone in several times to view the memory files its generated out of curiosity, and checked out the various skills it has built in, etc. It's just all there (with the caveat that who knows what else Meta might be doing, because the company is run by a sociopath.)
If one would have asked me how a consumer-grade Clawbot-like AI agent such as Muse, Dots, GrokBot, or Duet should be made to instill the most confidence, the way Meta did it is exactly what I would have described: Bundle the whole thing into a lightweight VM and make sure it's all visible to the end user. Done.
In terms of what this means for Duet as a consumer service? Very little. No one besides techies are going to bother to look at an agent's directory structure or care much about the loads of text it creates. But still, Anthropic should open up.
no?
just me?
ok
In my experience, those insights often end up having little to do with what actually matters to me in the real world. I'm not sure more integrations and more context are necessarily the answer.