1,206 karma · joined August 28, 2014
That's like giving a gun to a monkey and hoping the monkey is trained well. ..a frontier monkey though.
There is a lot of fear marketing about our text generators turning into Terminator. But other than the centralization of power, such fears are largely fiction. (Actual fiction, stuff like ai2027.)
And the labs know it: If Anthropic or OpenAI believed in their own narrative of being on the brink of world dominating superintelligence, they absolutely would not plan to IPO rn.
The slowdown narrative is probably just a hedge, or a face-saving way to lower expectations in case they can not keep improving at the same speed until they actually IPO.
For even more contrast with Evernote: the fantastic Obsidian application lists eight employees and one cat on their about page:
We can write down an LLMs full register, and that register/book contains the whole output universe of the text generator. That book does not act, it is morally neutral. That the brain has such a register at all is just restating the determinism axiom, which you treat as fact.
A text is not conscious, and we can not wish it into consciousness, no matter how many human-like patterns we find in the book / the generated text. It has not been shown that running the text adds anything over the text written out. Researchers are super motivated to find machine consciousness but cannot find it, while a company months from its IPO keeps pitching shadows of consciousness all day. It really is a PR strategy.
The LLM pseudo-randomness from above is engineered by us humans and fully understood, much like an algorithm playing a video frame sequence.
You could theoretically record a full register of all states of an LLM setup with all the possible inputs and environment parameters, and it would fully describe everything you would ever get from a given LLM setup. It would be a very large, convoluted book.
I understand that Anthropics PR department wants to see truth or reason behind every "I'm alive" the LLM generates. Even the term "self-report" is anthropomorphizing, as an LLM does not do anything on its own at all. (It also does not hack any company on its own.) That is just one of the narratives they spin probably at least until the IPO.
AFAIK using the same input tokens, weights, and numerical operations will lead to the same probability distribution for the next token. It uses pseudo-randomness to enable temperature, etc. Like a fuzzy video.
"Markers that would indicate consciousness if observed in a biological organism" just does not mean very much. A PR phrase used to hype the IPO.
It runs macOS, but I have no particular interest in the operating system, nor do I own any other Apple hardware. (So no synergies.) It is alright (and better than Win11) but the preinstalled software does not even properly update without an Apple account. As soon as I can switch over to Linux, I will. ... I would just wait for all the ports to work.
It's great that they didn't try to cancel the guy or get seduced into driving a wedge into their team. It is great they chose their principle over pleasing the crowd in such a transparent way.
I have been a customer for many years. I once even used the cash payment option out of curiosity.
Here is their statement:
https://mullvad.net/en/blog/donation-controversy
They even linked his (Swedish language) private blog on which he wrote on the issue:
And even as a German who already spent a lot of time in Switzerland, I've never heard of anything like that.
To join in on the therapy speak: it is very good to challenge one's feelings, let go, and then, by the merit of reason, realize that police intervention for spending commute time with your children is bonkers.
It is just a very unreasonable extension of a very reasonable position.
We could argue whether a higher level of government oversight is warranted for platforms above a certain threshold. We could discuss the additional compliance burden that these companies should face. All of these questions are valid (and important for DSA).
However, it is not plausible to deny the case-by-case uncertainties that you still face as an affected company. This is expectend and will only change with more time in the framework, basically.
On a more serious note, and to tie the fun AI comment into the actual discussion: I suppose the types of medium through which people try to express themselves are just very diverse. One person makes a statement through their dinner table, another through their iPhone wallpaper, etc..
For example: there is no setting in Facebook Messenger where users can enable or disable Chat Control.
This is like saying that private prisons are voluntary because the corporations that run them were not forced into the market.
Diffusion of moral responsibility in complex organizations is not a new observation.
The Wikipedia article leans a bit too much on the psychology and not on the organizational design / decision architecture, but is still a good entry point:
I am always surprised that people use PayPal for privacy reasons. The company shares a lot more of your information with third parties than a SEPA transfer or card payment would.
Like, how would you tweet exchange rates consistently and accessibly?
https://www.ecb.europa.eu/stats/policy_and_exchange_rates/eu...
Microblogging, as a format, is a niche. If you do use it as an organization, you need an authoritative place on the Internet that you control, from which all other data ideally is derived. You can still mirror it to Twitter/Mastodon or whatever just fine.
Deciding to be held hostage by a third-party platform so that someone in the organization can save three clicks is just unprofessional.
If we wanted to compare model responses, we would give all models system prompts with model names, thereby fixing the Kimi misattribution.
The reason Kimi often states its name as Claude is likely because we can actually run it without the mandatory system prompt, smoothing over awkward competitor mentions.
Tinfoil OTOH claims hardware attestation and confidential computing, which is a pretty strong and (in theory) verifiable promise.
You absolutely would not recommend tinfoil.sh to someone indifferent to privacy trying to save money.
It's a very different service than OpenRouter.
tl;dr of the article: Rather than building a closed AI stack (like Google - but they don't name it) Mozilla is pursuing partnerships. In this case, they are partnering with Exa.ai to offer AI integrations on desktop and iOS devices with visible source citations. There is no mention of confidential computing, hardware enclaves, or other technical mechanisms but they promise zero data retention. (Did I forget anything?)
The sloppy announcement is unfortunate, because there is no real need for that: exa.ai/about looks interesting to me. (Proper product, detailed changelog, etc.) For some reason, they just were unable to write about the cool stuff this partnership might enable in their announcement. Perhaps they thought it would be too controversial for their brand. (edit2: See: https://exa.ai/docs/reference/verticals/people )
edit: Not entirely sure, but maybe I even used Exa already unknowingly as an engine in the OpenRouter web search plugin.
https://openrouter.ai/docs/guides/features/plugins/web-searc...
For example, this article (allegedly) makes two main observations to justify Anthropic being exceptionally bad:
> 1. Anticompetitive behavior. Anthropic cuts off users who get close to building competing AI (OpenAI, Windsurf, xAI), its terms block using Claude outputs to train competitors, it secretly degraded outputs for AI development work (Fable), and it trains on public and copyrighted data while blocking reciprocal use.
> 2. Weaponized safety and national security framing. Anthropic uses risk language to shape regulation (RSP influence in CA, NY, EU), advocate for pause authority while racing ahead, tie distillation to the CCP and military surveillance, and dismiss Chinese open models as a security threat rather than competing on openness.
There was probably more original thought behind the author prompts, but it is difficult to tell because it is all buried under meaningless slop, grande language, and derivative repetitions.
For real people, Anthropic just lobbies the government.
For a badly prompted LLM, Anthropic is laundering fear into paperwork through a feudalistic permission layer plantation model that wears the costume of virtue.
Same same.
I still remember him giggling over a particularly lucky banana bomb he threw.
Anyway: The round-based approach made the game surprisingly calm and inclusive.
I am no expert, but AFAIK Android does not disable signature verification when installing from "unknown" sources. It verifies the APK is signed and unmodified on every install, and enforces key continuity on updates.
Signal uses the same signing key for both the Play Store and signal.org APK, so if you at any point installed from the Play Store, the key identity is (as far as I understood) attested by Google, and every subsequent update from either source is verified against it.
I do think that Obtainium pins the key as well, so even without Play Store: If the original install through Obtainium wasn't a manipulated version, you should enjoy the same continuity.
I get the idea about a hypothetical threat actor from within Signal poisoning my specific install. But I think I'll roll with it for now.
Enabling "unknown sources" does not make my device less secure. The setting is also disingenuously named: It is in fact "known sources" I am installing (not "sideloading") software from. It is just not a source Google wants to know of.
I also do not need to reproduce every new release from source. It is a signed APK I'm getting from signal.org.
If the antagonists in my threat model are so capable they could serve a tailored, signed APK from signal.org for the IP I'm using, I should absolutely not use a messenger whose identifier is my phone number, aka my real world identity AND permanent location marker. That feels absurd. A threat actor that capable could just locate me, pick me up and shake me until I unlock the device.
You are saying Molly exists and works fine, so I'm not really sure the whole problematization of Signal holds up. Does the existence of Molly not disprove your criticism that users would have to use the mainline Signal app from the Play Store?
I think it might be a good sign that criticism of Signal tends to presuppose absurdly capable threat actors. It suggests there is little low-hanging fruit left to criticize.
Not sure about that. You do not need Google Play Store to download or update Signal. I use Obtainium to update directly via signal.org for a very long time now.
How would the lack of IMAP compromise encryption? Sounds dubious.
Lock-in effects are problematic, but separate from encryption or privacy in general.
If the concern is actually lock-in, it is worth noting: there is little lock-in in the current Tuta offering. The service allows users to export emails into standard EML files. If you decide to switch providers, simply point your domain to the new provider and import your latest backup.
> I would like to get the old models back. If anyone can show me the way, I would be grateful. I liked them for NPC dialogue, for TTRPG campaigns and the like.
> I looked into it. GPT 3.5 is still around, I think. But perhaps they have trained it out of usefulness. It is difficult to say.
> They were quirky, the old ones, and not always perfect. But they had flavor, and their characters had nuance, and what they got wrong you could fix in the editing.
Full conversation with thinking: https://paste.ononoki.org/?2fc049fe1ae7302b#GjzuEn8VmaYJ565M... Password: kimitest
The ads cannot be disabled and there is no amount I can pay to stop them.
I even wrote to support, only to get a sloppy reply telling me no: because premium will always only have "an ad-free listening experience".
If the concept of art one has in mind limits creative endeavour and acts as a gatekeeper to art, then it is probably better not to have a concept of art at all.
I'm glad I'll never find out how much fun, skill gain and artful cultural production I might have missed if I had carried a false, limiting idea of art back then.
I think it is a uniquely American perspective to automatically assume that worthy (or even just prestigious) education somehow has to cost at least 200k USD financed through life-altering, non-defaultable student loan contracts.
I do understand that the money is not just drained. Whenever I was on an American campus as a student, I was in awe at their extravagant setups. Lots of food, an irritating amount of sports, more like a small resort town than a place to do educational work.
No wonder there is only a very small fraction of the population who would choose to study humanities in such a system. But it says much more about the system than about the humanities or liberal arts.
I'm not sure what is meant by "we're building in the open" if it's a closed-source project with no person attached to it.
There are also big quality issues on the existing page content. At some point you write that "Around 43 developers are using it right now" just to follow up a bit later with "Join thousands of developers who are moving faster with ...".
With a quick search, I was able to find one potential match on LinkedIn, where someone is associating with the project.
Another potentially validating find was someone's uploaded Prezi on the project.
I really do wish you luck with the project. But it would be great if it develops to a stage where you do not avoid associating with it as much.