https://www.ft.com/content/8158cb5a-4bbd-43fd-b329-15a54e842...
92 karma · joined March 3, 2023
https://www.ft.com/content/8158cb5a-4bbd-43fd-b329-15a54e842...
Interesting, would love to know the details of this.
- those who needlessly reduce things to binaries
- those who articulate nuanced positions that tend to confuse and bore people
- those who lose the plot entirely by making self-referential meta-points
I really appreciate you sharing this!
Like others, I'm skeptical about the business model. That's not really a knock on you (and I wish you the best of luck), but rather with the whole ecosystem of these kinds of apps. There are three big problems:
- Everyone and their aunt is trying to sell me monthly subscriptions for a few bucks. These add up, both in terms of $ and cognitive overhead (yet another subscription I need to remember to cancel if I stop using it...)
- I don't own this system, I'm just renting it. This is a trade-off I'm less and less willing to make for a whole host of reasons including my ability to vibe code my own thing, open source, enshitification (or, perhaps more likely, you deciding to abandon this project in the future) etc
- All the usual concerns about data security and privacy are heightened right now in this era of super-capable hacking agents and super-creepy AI companies
As a user of things, vibecoding is the most exciting thing about AI. I can make anything I want to use, built exactly as I please. As a maker of things, vibecoding is the most damning thing about AI. Anyone can re-make anything I've made, built exactly as they please.
maybe a thread that is just these types of narratives?
The article is also dismissive of the Hugging Face incident and other hacking incidents. This one is trickier, because we are more reliant on what the companies have released to piece together what happened. The METR report is probably the closest thing we have right now. Here again, I think the issue is that a lot of coverage blends the ethical issues (holding AI companies responsible for what their bots do) with capability issues (whether AI is or will be capable of developing novel and dangerous attacks).
(And to be clear: I’m not talking about being skeptical of fantastic claims about things that have not happened- ie an AI takeover, runaway super-intelligence, etc.)
This is totally obvious in retrospect but I never thought of it (probably because of 25 years of thinking about tools in terms of reusable components).
Thanks for writing!
Perhaps we might ALSO decide that this new explosive is so dangerous it needs specialized laws to protect the public, but that would seem premature if all available evidence indicated that the explosion would not have occurred if the company had taken the most basic precautions.
Similarly, AI companies should be required to allow distillation at a fair price. Fair Use doesn’t make sense as a social contract if it only cuts one way!
Of course in cases of negligence a tool maker could also be held partially liable. That’s a matter courts can decide. The main point is we shouldn’t jump to making special laws around the development of LLMs. The starting place should be enforcement of existing liability laws. New laws take time and will be heavily influenced by AI companies seeking a regulatory moat for their business. Moreover, it is a distraction from the illicit behavior that is already going unchecked.
As far as perceptions goes, it feels very tone deaf of Apple to launch this feature in this way at this time. Read the fucking room guys.
*How Siri Recap respects those around you* By design, Siri Recap does not create a recording, does not produce a verbatim transcript, and does not identify and attribute speakers. The output is a brief, high-level summary, comparable to notes a person might write after a conversation. There is no audible signal because no raw audio is retained, and there is no way to reconstruct the original audio from a Siri Recap or share raw audio with anyone.
Siri Recap is an electronic record of a conversation that includes timestamps. Imagine for example that during a scheduled meeting with my boss, he threatens to fire me for not doing something illegal. I now have strong evidence that this was said (even if it cant be officially attributed to him) during the time I was in a meeting with him. Not saying this will hold up in court, but it certainly is more damning that having written notes (not to mention the fact that my boss probably wouldn't say this when I am taking written notes).
I expect a lot more of this kind of drama in the near future.
Distillation is a threat to frontier model companies, but that doesn’t make it dangerous or wrong. OpenAI can (and likely will) use the same logic to ban you from using open source harnesses.
Even though this dynamic may not last, I think this is a really positive thing. Since their inception, EVs have been seen as a luxury item for tech elites. This is finally changing. More and more people start to see EVs as a good way to save money. This change will do far more for adoption than the tax credits we lost.
Long live the EV shit box!