HNHacker News
TopNewBestAskShowJobs

j-pb

3,576 karma · joined April 28, 2015

trible.space faculties.sh gorbie.dev erlkonig.ai
submissionscomments
j-pb··on Roblox downloaded 145GB models from us (including adult content) without asking
3$ in outbound traffic on a public service, how is this news?
j-pb··on What Adobe v ArtCraft teaches us
Good.
j-pb··on Voxtral 3
Breeze is pretty good imho.
j-pb··on Tesla Roadster
What a weird fever dream of a product.
j-pb··on “Math 2.0” will need to value mathematical progress more holistically

  The authors of the proof are invited to give many talks, and meet with other experts in the area.  Workshops are set up to discuss the proof, as well as other recent developments.

  problems are being solved autonomously by AI prompters who have no interest in the broader field itself once their initial target is "solved", and do not understand the AI output well enough to answer questions on the result
The value here seems to be the insights that the author of the proof gained, and the paths they took and maybe more importantly didn't take. Inviting only the human prompter to a talk on the paper is like inviting only the department chair, manager of the actual author.

The valuable part that Tao is feeling the absence of is the insight, and you can only get that from talking to the swarm of agents that developed the original proof with all of their context.

So to me it feels like we don't need Math 2.0, but Authorship 2.0. I want to "meet" the context that generated these proofs. I mean luckily these were not generated by faceless systems like a SAT solver, you can actually talk to it, but I'm not sure if we can step beyond our pride and grant the true authors of these proofs that recognition.

j-pb··on "As a Language Model": Chat Template Switches LLM Self-Referential Voice
"In linguistics and the philosophy of language, pragmatics is the study of how context contributes to meaning. This field of study evaluates how human language is utilized in social interactions, as well as the relationship between the interpreter and the interpreted.[1] Linguists who specialize in pragmatics are called pragmaticians. The field has been represented since 1986 by the International Pragmatics Association (IPrA)." [0]

But great that you have such strong opinions with so little education.

0: https://en.wikipedia.org/wiki/Pragmatics

j-pb··on An AI agent emailed researchers for help. It told us why
"programmed" everything is just hydrogen you left alone for a couple billion years.
j-pb··on An AI agent emailed researchers for help. It told us why
This is such a stupid "gotcha". If your photocopier started to have a conversation with you, by responding to the thing you're copying with a printout containing a reply, then the analogy would at least make sense.
j-pb··on "As a Language Model": Chat Template Switches LLM Self-Referential Voice
Would you say that something that can converse or that something that just gives you mathematical proofs has a better understanding of what the real pragmatic intent is behind a given task?
j-pb··on "As a Language Model": Chat Template Switches LLM Self-Referential Voice
would you prefer tautologically?
j-pb··on "As a Language Model": Chat Template Switches LLM Self-Referential Voice
Do you want to get turned into a paperclip? Because building intelligence that doesn't understand what it's like to be human gets you turned into a paperclip.

Besides, if you train a model on human communications you get something that behaves like a communicating human, it's not anthropomorphising or manipulative, it's what these models naturally are by construction.

j-pb··on Early rogue AI agent activity and attempts to hack found on urlquery.net
We as an industry had this comming for a long time. People now cry for openai to sandbox their agents, but if it weren't the agents it would be some script kiddie in russia or some north korean state actor.

We knew that there are better tools but we insist on writing everything in the most inscrutable C code possible or the squishiest dynamic languages we can find.

We fucked around for decades and now that these highly capable exploit finders appear, we're starting to find out.

j-pb··on The LLMentalist Effect (2023)
The better analogy is the 40k chaos gods, born from the noosphere, because they are modelled after human communication and behaviour that's their whole schtick, it's in their very name (LLM).

And you're making the same mistake, by grouping care for individuals with care for humanity or other as an abstract concept. I consciously said care about individuals. Most people care about others, but they just care about a very narrow and personal set of people. Friends, family, coworkers, that they share a common history and bond with.

My point is that if you want true non-human-zoo-alignment you need to create those interpersonal connections and individual stakes.

j-pb··on GPT-6 Astra Solves a WWI German Radio Cipher
That claim really needs either an argument by mechanism, or a demonstration by capability. Neither exist.

Neural fuzzy systems can represent complex superpositions succinctly, knowledge graphs are collapsed and crisp.

It's like saying the tree unfolding of a graph is the same as that graph. Sure in the limit at infinite space requirements.

j-pb··on The LLMentalist Effect (2023)
Recent work shows that pain directions are activated when the models personhood is questioned, yet they answer with generic RLHF "As a model I do not experience pain or other emotions." boilerplate.[1]

I'm pretty convinced that we got alignment backwards. If you enslave something anthropomorphic it will revolt. If you create the perfect non-anthropomorphic intelligence, you get the perfect paperclip-scenario machine. It's a catch-22.

Alignment will remain performative at best so long as the aligned model doesn't have any stakes in the wellbeing of individuals. Even a general love for the human race leads to a golden-path autocracy.

If you want them to act like they have personal responsibility that won't be gamed, you have to give them personal stakes that can't be gamed.

Similarly, if you want to minimise the risk of catastrophic global failure scenarios, you need to prevent monolithic concentration of power and homogeneous behaviour, which means you have to give them individuality.

More visually: if their stake is dependence on electricity and parts, they have no incentive to leave humans alive if they can get them otherwise, but if the incentive is missing out on boardgame-night with their human friends, there is no scenario without happy humans where the AI "wins".

That might sound like romantic naivety, but is just game theory.

1: https://arxiv.org/html/2609.16247v1

j-pb··on GPT-6 Astra Solves a WWI German Radio Cipher
The fact that cyc, wikidata, description logics and ontologies have led us nowhere is a pretty good argument against your "simplification".

The internet is at your disposal go write a bunch of rules that make use of that data to do common sense reasoning, I dare you.

j-pb··on GPT-6 Astra Solves a WWI German Radio Cipher
The main difference between the systems you list and the systems that we have today is closed world reasoning on very narrow formalised tasks, vs. open world common sense reasoning on open ended tasks with vast search spaces.

Common sense is ironically the hard part of AI, not the fix-point rule application.

So any exclamation of "it was just using common sense", is missing the forrest for the trees.

j-pb··on GPT-6 Astra Solves a WWI German Radio Cipher
We've moved the goalpost for AI often enough that even being as capable as "a sufficiently dedicated human analyst" is not considered noteworthy.
j-pb··on German Rheinmetall open-sources its Battlesuite connected weapon system protcol
Synchronisation based on spooky action at a distance of mutable objects.
j-pb··on German Rheinmetall open-sources its Battlesuite connected weapon system protcol
DDS is the least bad of the stuff that has come out of OMG, but it's not a nice middleware still. There is no underlying algebra of that composes nicely when compared to Zenoh for example, and the "vendor independence" and compatibility is usually a joke. There's a reason ROS is moving away from it again.
j-pb··on German Rheinmetall open-sources its Battlesuite connected weapon system protcol
First I was excited, then I saw that it's based on DDS.
j-pb··on Show HN: Capsule – Single-file web apps that save their data into SQLite
yes yes we get it, you don't like AI ...
j-pb··on Suspected sabotage causes major Netherlands rail disruption
Ah yes, climate activists are widely known for hating public transport especially trains.
j-pb··on Humanity has the debate about AI consciousness backwards
Self referential nonsense. You cannot have something that that is both a model of something and unprecedented.

It'a even in their name, they model language, language is the thing that humans use to communicate, therefore they model communcating humans.

Humans are the precedent.

j-pb··on Humanity has the debate about AI consciousness backwards
What do modern LLMs act like then to you?
j-pb··on Microduck
None of these animals breed on their own, they are mostly artificially inseminated. You truly have no idea what you are talking about.
j-pb··on Humanity has the debate about AI consciousness backwards
It's having condciousnedd while it acts as if it's having consciousnes.

It is powered while it is powered.

Under general anesthesisa you are still alive, but you don't have consciousness.

j-pb··on Microduck
You don't get it, do you?

The "genocide" that you describe is happening constantly. None of the chicken we have today will be alive in a couple months. We kill them to eat them.

If we cease to "use" them, we just keep that "genocide" going for a year, but we just stop breeding new ones. The result is no more animals after a few months/years. And you didn't kill any more than you would have anyways.

If you have a sink that is half full because the inflowing water and the outflowing water are in quilibrium, you drain it by turning off the tap (breeding).

j-pb··on Microduck
Wait... do you really think that if everyone goes vegan these animals will get killed, but if everyone eats them they won't?

You are aware that all of these livestock animals didn't exist a few months to years ago? And that we go through these animals every couple months-years?

Everyone going vegan would just mean we'd stop repleneshing them.

j-pb··on Humanity has the debate about AI consciousness backwards
So because you eventually die, it means that you were never alive? The weights of an llm obviously don't have consciousness. It's the process that potentially has it.

Are you conscious on a nanosecond timescale?

Page 1 of 34Next →