HNHacker News
TopNewBestAskShowJobs

thomascountz

1,912 karma · joined August 26, 2017

https://thomascountz.com

My career is guided by three core principles: to create, to learn, and to share.

[ my public key: https://keybase.io/thomascountz; my proof: https://keybase.io/thomascountz/sigs/M83KX58eHE-LOM7b3BsNT98J4Fx_TAlqbdMG7AvHqdg ]

submissionscomments
thomascountz··on Every Mac comes with an (undocumented) family member classifier
OK, and just to prevent any aspersions from being cast on the author and/or contributors, I have nothing to do with iKnow or this research.
thomascountz··on Every Mac comes with an (undocumented) family member classifier
I don't think your request is reasonable because I don't agree with your (or your LLM's) categorical assertion and risk assessment, not because I misunderstand the mechanics of the threat model, as niche as it is.

Also, small correction: any app with Full Disk Access can access this data.

thomascountz··on Every Mac comes with an (undocumented) family member classifier
I would go further and suggest that you do not access any website or open any files via your browser while you have malicious browser extensions installed. You do not need this project's README to tell you this.
thomascountz··on Every Mac comes with an (undocumented) family member classifier
At one point in my life, I would've found this data fascinating (if it were opt-in, perhaps)! Now, I find it exhausting.

A similar discussion came up recently with Siri Recap[1], where some expressed how useful they thought it was and that, as a party to the conversations it summarizes, there was very little moral or ethical concern. But I have a social concern.

If I'm having a chat with someone, there's a milieu constructed around the fact that not everything will be remembered verbatim. There are all sorts of social and contextual cues that can easily get lost if listening gets replaced by flat relentless transcription.

With Recaps and this social graph (were it to be productized), the informal fluidity in the way we relate to one another starts to go away, and the expectations that follow from that become artificial and burdensome. In the same way that autocorrect has made typos unacceptable, how could you ever be forgiven for forgetting the name of your colleague's new nephew or the Italian village that your neighbor took a spontaneous boat trip to while on vacation last year?

[1]: https://news.ycombinator.com/item?id=49641401

thomascountz··on Enough Phone: A new small phone
I'd be happy to see this succeed.

Speaking of small phones, I'm still not sure why Apple doesn't make an iPhone SE or Mini again. Surely it will sell at least as many units as the Air or Duo?

thomascountz··on Toit v2.0.0

   Toit is a language for writing scripts on your computer and applications on your ESP32. A readable syntax, an efficient runtime, and tools that work together.

   Free and open source. Maintained by volunteers.
thomascountz··on NASA's Voyager 1 mysteriously lost touch with Earth
On the one hand, it has crashed into a lot of somethings—like cosmic radiation and micrometeorites. On the other hand, there is a lot of space in space, and the chances of Voyager crashing into something of the same or larger scale as itself is infinitesimal.
thomascountz··on Fable Took My Job

   We're heading towards the end of the year and I still do not see how these copy-machines with "super intelligence" inside are going to replace humans. What they have done is convince those with money to spend differently on their fellow humans.
Whether LLMs can successfully replace certain functions is a question of speculation and conjecture. Whether LLMs should replace human roles is both an economic and moral question. When the incentives are what they are, there's little room for objectivity. Both those who stand to—or believe they stand to—benefit most and those who stand to be most harmed by copy-machines replacing humans will be inclined to think of "when it will" happen. Only one of those groups seem to be able to actively participate in asking "whether it should" happen.
thomascountz··on I'm sorry, but you still have to think
I don't generally think of myself as cynical, but yeah; this is what people in our industry seem to be asking.
thomascountz··on I'm sorry, but you still have to think
This post resonates a lot with me and my approach to counter the idea that an LLM (as amazing as a tool it is) gives programmers permission to stop engineering. To me, executing a decision in the face of trade-offs is what the job is all about.

So, I want to keep pulling the thread: is it worth reading—meaning, understanding—the code in order to prevent p95 latency from skyrocketing, avoid OOM death, and keep our apps reliable for customers?

The cost of understanding the code is ostensibly very high relative to just using a clanker (citation needed), so does paying that cost translate to value—what is it worth? Concretely, if vibe coding increases bugs and enshittification, but decreases spending without decreasing revenue (read: customers suffer, but they don't leave), do we still need to pay the cost of reading code? Is it better to invest in stickiness, lobbying, and market capture?

This comment shouldn't be read as advocating for this; it's a thought experiment about pragmatism and trade-offs, and reflects what I'm witnessing companies (and "programmers") asking themselves. I personally care a lot about understanding systems and code, and I believe I'm paid to do exactly that (I very much enjoy understanding code and nobody is paying me to run a business, so I may be biased in this). In everyday SaaS-land—not talking about critical safety systems—we've seen production databases destroyed, personal data leaked, platforms unwittingly exploited, and UX bugs creep into our operating systems, and yet the companies involved keep on keeping on.

Is thinking, meaning taking the time to actually understand what our systems are doing, going to increase their shareholder value?

thomascountz··on Five months treating bugs like patients and coding agents like a medical team
I have qualms and disagreements with the whole "software factory" concept, but your math doesn't help the argument. The cost of human labor is more than salary—or even hourly rate, if you're thinking of paying a contractor.
thomascountz··on Once: Cache CLI commands
Hey! I use your shell script after seeing it on HN awhile ago. It's very handy (I find myself reaching for it as if it's a built-in) and I appreciate its design (I learned a few things reading it)!
thomascountz··on What I did at Recurse Center
I don't get it. Why would you ask if an adult daycare leads to a business or new discoveries? Daycares are for nurturing curiosity and fostering development in a socially engaging environment—much like the Recurse Center—not for publishing papers.
thomascountz··on Real-time feedback: My closing move in every interview
As an interviewer, it's my role to get the information I need to help inform a decision that I will not make alone. If I have a concern about some unknown, I have to navigate that; it's on me. I expect an interviewee to be prepared to share relevant information, but interviews are stressful and if I only want to hire good interviewers, I'm going to have a considerably smaller pool.

Furthermore, as an interviewer, my job is to be a candidate. Why should this person choose my team/company to work at? It's a privilege that anyone show up to join, and I ought to be as prepared to give answers as they are.

That said, any "feedback" I would give would be arbitrary. I am not this person's mentor and I shouldn't—after only 40 minutes—assume I know enough to give them feedback. Saying that I have concerns about not getting enough information, and that somehow being their "feedback," is bad framing. Try:

  Before moving on, I really want to make sure I get a full picture of your time at Acme working with the Foobar team. Would you say that you led project X? Who ultimately decided when it shipped and set deadlines? Was that part of your responsibilities?
I'd recommend avoiding giving anything framed as feedback altogether. End interviews by saying "We're all finished with this part of the interview. Thank you for taking the time to go through your work history with us. You should be hearing from [Hiring Person] about the next steps."

I know TFA mentioned similar things about also being a candidate and that the "feedback" is to spur discussion, but the framing of giving "highly opinionated" thoughts about someone's capabilities as a way to ask questions is unnecessarily adversarial is an already power-imbalanced situation. I think it's better to try to tilt the power imbalance in the other direction—giving the candidate a feeling that you, the interviewer, are also auditioning for them. Doing that shows humility and, in my experience, gives a better opportunity to get to honest answers about being a good fit for each other.

thomascountz··on RubyGems Open Source Supply Chain Security and OpenAI
Related:

What a time to be alive – rouge AI agents attack RubyGems.org (tenderlovemaking.com) - https://news.ycombinator.com/item?id=49695876 - Sept 2026 (123 comments)

thomascountz··on OpenAI agents carried out an undisclosed attack on RubyGems
Why are people using petrol-powered lawnmowers in 2035...

But anyway, these scenarios assume the agent's actions are accurately observable and logged. Something I wouldn't put much faith in based on what we've been seeing so far.

thomascountz··on Tao: Open math problems being non-renewably mined by AI
There's an analogous (albeit, far less existential) problem in software development. If the answer to, "what should we build next?" is simply, "yes" (so to speak), then the real value is in the discernment of "what is most valuable, useful, sustainable, and/or meaningful thing to build next".
thomascountz··on I resigned from Anthropic today
I am pivoting from the literal "extinct," taken as meaning the eradication of the human species, to the concept of "the collapse of civilization," as I find the step from one to the other insignificant compared to the leap from where we are today to societal collapse, and the potential for societal collapse due to our abuse and misuse of technology is made apparent by the fact that humans have inflicted genocide because of words in books.
thomascountz··on I resigned from Anthropic today
Not to be completely pedantic, but the fact that one, and only one, individual in the United States of America can deploy any of their 5000+ nuclear weapons undermines this argument. Furthermore, LLMs (as they are today) which pose the treats mentioned in TFA, are expressly not available to individuals (for the time being). However, my point was never about individuals, but rather of systematic incentive structures which actively make pathways to specific harms possible—if not probable.
thomascountz··on I resigned from Anthropic today
This is a fair distinction: extinction vs collapse of civilization. I was using "extinction" too broadly by including the disintegration of the systems that make human survival (as we know it today) possible.

That said, I can't completely hold onto the belief that extinction is completely off the table. That feels too much like hubris, and the step from collapse to extinction doesn't feel as if it costs much. Though it does make my arguments weaker, I am more interested in protecting civilization as it's the most recognizable form of humanity to me.

In either case, the cost-effective safety argument is compelling. Whether to save civilization or humanity, the wealth incentive is powerful enough to threaten life as we know it.

thomascountz··on I resigned from Anthropic today
I'm not sure. There's a lot of incentive to not "snap out of it": money, peer pressure, etc. Removing these incentives take a long time. See other socially harmful behaviors with real incentives: anti-vaccination, air and water pollution, over-consumerism...
thomascountz··on I resigned from Anthropic today
As a technologist, I can use my imagination. There are incentives in both directions, but I am less afraid of being overly cautious and preparing for the potential harms.
thomascountz··on I resigned from Anthropic today
Admittedly, that point of my argument is purposefully obtuse. In a literal sense, of course this is about computers in LLMs.

The delineation is to highlight that the underlying issues: human incentives, power, and institutional failure, existed prior to and without LLMs or computers. LLMs are not inherently harmful, they have to be deployed (unwittingly or otherwise) to make them so. This is the same as saying that the internet is not inherently harmful, and yet it does facilitate harm.

thomascountz··on I resigned from Anthropic today
My delineation is an argument for greater caution and agency, which it appears you are also arguing for.

I also mean to say that "LLMs" carry no inherent harm to humans. To make an LLM dangerous, humans must make it so. Is that the goal? This has implications for how to read TFA.

thomascountz··on I resigned from Anthropic today
I agree these dangers are connected. The danger comes from human institutions and incentive structures which (having existed long before now) are being exploited and exacerbated by LLMs, making them harder to ignore.
thomascountz··on I resigned from Anthropic today

   ...people to move to the poles/into caves/beneath the ocean/whatever
Cooperation required for the purported mass migration of civilization. Admittedly, I assumed you meant it would be civil, but perhaps that should be excluded from the priors.
thomascountz··on I resigned from Anthropic today
Perhaps I have a bit more imagination—or a bit more humility towards our humanity—such that I believe this is not "either/or". In the vast search space of potential future outcomes, of course even I can see humanity survive nature as I've seen nature survive humanity. However, I can also so easily see probable branches where we are our own undoing. Apropos of TFA, if one is to believe LLMs can carve a threatening path to humanity end, how could one not see the same for our much older extant threats?
thomascountz··on I resigned from Anthropic today
See: nuclear weapon development and climate change. See: supply chain shortages and war. See: disinformation against vaccines.
thomascountz··on I resigned from Anthropic today
There's little evidence that humans are able or willing to cooperate at this scale. See: the past century of climate change.
thomascountz··on I resigned from Anthropic today
Citation needed for evidence of human cooperation at this scale. As you say, climate change is slow moving, and there's no real evidence across the last 60 years of knowing about it suggesting humans are willing to do what it takes to survive it.
Page 1 of 12Next →