But I have a hypothesis.
The quality of the output, when you don’t own the long term outcome or maintenance, is very poor.
This is not the case with AI in the same sense it is with human contractors.
5,626 karma · joined May 6, 2009
Current projects:
https://trysojourn
https://getpreppy.app
https://trywireshark.com
Personal sites:
https://github.com/jmathai
https://github.com/photo
https://linkedin.com/in/jaisenmathai
Contact:
jaisen@jmathai.com
But I have a hypothesis.
The quality of the output, when you don’t own the long term outcome or maintenance, is very poor.
This is not the case with AI in the same sense it is with human contractors.
For my projects, I would have to replace the trim for the entire room and possibly adjacent rooms because the baseboard is the same throughout the house.
But if you're okay with or planning to replace all of your trim and could get it off-the-shelf then certainly that's a viable option.
Even if I had to reload manually very often, I still would not enable auto reload. These APIs are crazy expensive and I'm not looking for a surprise bill.
I load $20 at a time and wait for it to break and add more.
If your agent isn’t being used, it’s not as simple as “agents aren’t getting called”. You have to figure out how to get the agent invoked.
I attempted to productize a super niche idea I had for myself that I have ended up using multiple times. It's a simpler method of running wires without having to cut/patch drywall and drill through studs.
It started with trying to create a router-like device equipped with a motor (which was version 1 [1]).
But then iterated it to be a plate which can be attached to existing routers. That resulted in a drastically improved user experience which went from doing it all inside and making a mess to doing it in your garage with more precision. I've used the final design on 4+ projects at home and it has saved me so much time [2].
[1] https://www.dropbox.com/scl/fi/i5p330nqo0cfrfx3gxf05/Wiresha...
[2] https://trywireshark.com (includes diagrams and videos of what I 3d printed)
It's the hard part of using LLMs and a mistake I think many people make. The only way to really understand or know is to have repeatable and consistent frameworks to validate your hypothesis (or in my case, have my hypothesis be proved wrong).
You can't get to 100% confidence with LLMs.
/gh-issue [issue number]
/gh-pr [pr number]
Edit: replaced links to private github repo to pastebin.
For a medical use case, we tested multiple Anthropic and OpenAI models as well as MedGemma. Pleasantly surprised when the LLM as Judge scored gpt5-mini as the clear winner. I don't think I would have considered using it for the specific use cases - assuming higher reasoning was necessary.
Still waiting on human evaluation to confirm the LLM Judge was correct.
You get no feed at all. It’s marvelous.
Perhaps it has to do with the method used?
I don't think most people are in favor of illegal immigration. That would be an extremist view. Most people are probably somewhere in the middle and I don't think that band is too wide.
My usage of it would be quite different than ChatGPT. I’d be much freer in what I ask it.
I think there’s a real opportunity for something like this. I would have thought Apple would have created it but they just announced they’ll use Gemini.
Awesome launch Moxie!
That's all I wanted to say - as much of a milestone as version 10 is - the past 9 were amazing as well.
There's a lesser chance that you're working on a code base that Claude Code just isn't capable of helping with.
Even I look at the last commit date as a proxy for "is this maintained". I wish GitHub had something similar to "Archived" for projects like these.
While I enjoy the challenge of writing software, I more enjoy having the thing which does exactly what I want.
LLMs are amazing for this.
Does Loom really not offer this capability as an iOS app? I never checked but that's crazy if they don't. Regardless, I think this solves a problem for sure! Congrats on building and launching.
That being said, what will be critical is understanding business needs and being able to articulate them in a manner that computers (not humans) can translate into software.
Code quality can be poor as long as someone understands the tradeoffs for why it's poor.
I wish we'd pump the brakes on efficiency and profit.
Most recently, in 2024, I had medical and dental coverage for my family of 6 for around $1,200/mo - roughly half what's quoted but again, family of 6. Wasn't the greatest insurance but it would have kept us from financial ruin in case of a catastrophic event which is all I expect from insurance anyways.