374 karma · joined September 19, 2015
While you can make embeddings across different LLMs similar (i.e. universally looking) the few percentage of R2 that you are missing in translating the universal representation into a native representation are precisely those that make the hidden states executable in the LLM (which makes them useful).
They do this with simple embedding models because there the purpose of the embeddings is to measure similarity, but if you would like to use this principle to turn latent representations of one LLM into latent representations that are understandable/executably by a different LLM, you will fail.
Truly dismal science of an Economics professor at MIT.
Perhaps some people are offended by this argument, but it's definitely worthy of a discussion instead of censorship.
(Check it out if you're into seeing cool live rendered Slime Mold animations)
> In response to this threat we want to inflict damage on machine intelligence systems.
I'm sorry but this sounds infinitely idiotic.
The CogniLoad benchmark does this as well (in addition to scaling reasoning length and distractor ratio). Requiring the LLM to purely reason based on what is in the context (i.e. not based on the information its pretrained on), it finds that reasoning performance decreases significantly as problems get harder (i.e. require the LLM to hold more information in its hidden state simultaneously), but the bigger challenge for them is length.
https://arxiv.org/abs/2509.18458
Disclaimer: I'm the primary author of CogniLoad so feel free to ask me any questions.
This is a pure fearmongering article and I would not call this research in any measure of the word.
I’m shocked Times wrote this article and it illustrates how ridiculous some players like Pallisade Research in the “AI Safety” cabal act to get public attention. Pure fearmongering.
he was wrong about many DL paradigms and didn't contribute in any way to the advances that brought us LLMs for at least the last decade, but now since he won the Nobel (undeservedly imo) his wrong opinions get publicity and misinform the public and decision makers.
i think it's the mark of an intellectual to recognize when the world has moved on so far that your idea of it is outdated and wrong. he missed that mark.
Whats perhaps interesting to note is that this charge was made for "just" 41 [1] confirmed starvation deaths among a population of 2,141,643 people [2].
Of course every death caused by intentional starvation is a severe crime and must be punished, but in the context of the victim numbers that most past crimes against humanity have had, it sets a relatively low new bar.
"... As services which enable direct interpersonal and interactive exchange of information merely as a minor ancillary feature that is intrinsically linked to another service, such as chat and similar functions as part of gaming, image-sharing and video-hosting are equally at risk of misuse, they should also be covered by this Regulation. "
https://cdn.netzpolitik.org/wp-upload/2024/05/2024-05-28_Cou...
I'm absolutely certain the real time processing would be unfeasible in any other technology in terms of complexity and the minimal compute resources it's running on.
Modules like broadway, ash, oban, phoenix liveview ... make it not just a pleasure to work with but insanely performant.
With over 20 years of programming experience, I can say with certainty that there is no language that makes me as productive as elixir. It's at least 10x my python productivity (despite being at an expert level in python as well).
Now it would be awesome if rabbitMQ and its client would run on OTP 27, would love to upgrade :(
paper https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3520684
thesis https://ora.ox.ac.uk/objects/uuid:a0aa6a5a-cfa4-40c0-a34c-08...