After using it for a couple months, I'm converted. They're so good, the more you use it, the more useful it is; you internalise more of what it could be used for. It runs so many boring parts of my life, leaving me with more time to spend with my family.
I liken it to release of the first iPhone; it didn't invent any new technology, but packaged different bits of tech together in a way that was consumer friendly. I think we'll look back at OpenClaw/Hermes/Muse/Instinct in the same way.
I do worry about using purely cloud based offerings like Muse, I reckon there is a market for someone to package an consumer AI agent that lives on your home network.
I built an app (in codex), that goes through my emails, pulls out any receipts, and adds the purchases to a sqlite database. I do all my grocery shopping online (through my supermarket), so our weekly shop is stored in the database.
Hermes uses that to predict what items will need restocking (based on how often I buy it, and when I last bought it).
Every week, it logs into the supermarket website on my behalf, books a delivery slot, and adds all the items that need restocking to the shop.
Throughout the week, if I run out of something, I take a photo of the barcode and send it to hermes, it adds it to the shop for me.
I built a similar app for travel; if I have any upcoming travel, hermes will send me updates (delays, platform changes etc...). I do a lot of train travel for work, if my train is delayed, it will automatically apply for the compensation on my behalf.
It reads my emails, and pulls any actionable items out, and adds it to an Asana list. I can either do the tasks myself, or assign it to Hermes and it will do it for me. As an example, I had an task to book swimming lessons for my son, hermes monitors the swimming lesson availability and automatically booked it when a suitable one becomes available.
Shopping is a good use case, I have a clock that needed a new battery, it wasn't a standard battery, and required a screwdriver to open the compartment. I took a photo of the clock, sent it to hermes, and it found out what battery took and ordered it of Amazon for me.
I wanted to buy some smart thermostats for our radiators, but wanted to be compatiable with our current smart heating system. Hermes is connected to my home assistant, so it figured out what heating system we have and found a compatiable set of eBay (this is slightly more involved than it sounds, as there is a new version of the heating system with a new set of completely incompatiable accesories).
I don't think "it does everything" or that it has "changed my life", but all of those examples are chores, things that I don't particularly enjoy doing; and if something can take it off my plate, then it's useful for me.
As for the rest, that is a lot of tokens burned to keep a fridge stocked.
Receipt emails are in a predictable format, so codex built scripts to parse the emails. If there is a receipt email it doesn't recognise, it will use an LLM to build a parser for that kind of email once.
The agent also "self improves", so after asking once to get items to restock, it wrote a skill with the query it used in, so it doesn't burn tokens figuring it out again.
I was impressed that after it logged into my supermarket account, it inspected the network traffic and discovered a GraphQL API, and used that (instead of screen scraping); much more economic.
I've averaged 2.6 cents a day in token costs over the last month.
For me my motivation is that I’m working 9-5, my children go to bed at 8pm, and I don’t have my phone on me so I can spend time with them.
Once they’re asleep, I’ve got 2 hours to spend with my partner before bed. I’d rather actually spend time with her rather than checking if we have enough kitchen roll.
Even as an experienced developer, sandboxing an agent is not trivial. The idea of my aunt, who has her passwords on a post-it-note on her monitor and forwards me scam emails using these things is terrifying.
I'll use personal agents for my laundry now. Thanks mate for the samples given
You can actually hire a person to do these things and it will likely be cheaper than any technological solution.
Most peers (Millennial knowledge workers) I talk to these days constantly discuss the feeling of "being overwhelmed", and I suspect a lot of it is just the info-sphere.
Neil Postman predicted some of this many decades ago in "Informing Ourselves to Death", where he argued that increasing the speed, volume, and accessibility of information would not necessarily improve society (i.e. information without context/judgment and institutional scaffolding can become socially destructive).
I really feel like we live in that world, and hence the rise of these AI agents as a potential "solution" to that.
My biggest use case is to coordinate groups. For example I tend to do big travel trips with like 4-15 people. Having an assistant coordinate group payments ("split this bill and get everyone's venmo accounts"), signups ("who wants to do horseback riding?"), takes all of "work" out of vacations.
I will NOT let it touch anything that it could unintentionally (or intentionally) leak sensitive personal info. So, anything that has a credit card, bank account, etc. is pretty much offlimits.
usage-time growing fast, with tasks and cron jobs.
in the last spacex earnings report (few hours ago), Elon said he thinks their grok-bot will next year make up most of their AI inference usage across their datacenters.
basically he tried to imply these bots/personal-agents get lots of usage once users start customizing them. and it is bringing in a lot of money in API usage.
No one ever answers why that’s bad, though, or behind what. Turns out it’s behind in the procession walking towards the cliff. Maybe not such a bad idea to stay behind on that one.