HNHacker News
TopNewBestAskShowJobs

Davidzheng

1,225 karma · joined January 28, 2020

submissionscomments
Davidzheng··on We must pace the frontier
Actually capitalism kind of has to end further down this road if we don't want to cede control completely to super intelligent ais and their direct "owners".
Davidzheng··on We must pace the frontier
Doesn't it just incentive the business to be outcompeted by one that uses ai more--unless the consumer is choosing based on morals
Davidzheng··on We must pace the frontier
??? Why

It can use the compute of the computers it hacks.

Davidzheng··on We must pace the frontier
There's also huge market pressures and probably large negative economic consequences of a slowdown--probably better than what would happen without it, but it helps keep the pressure just as much as fear of competition
Davidzheng··on More questions about whether researchers can trust OpenAI with unpublished math
Tbh it won't really matter soon.
Davidzheng··on Tao: Open math problems being non-renewably mined by AI
the second part is definitely not true
Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
Oai denies looking at prompts but doesn't deny training on them.
Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
Soon it won't be like this!
Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
But i don't understand what OAI is offering in the first offer to allow them to believe they can demand that? Not publishing before Tristan? If they really beat Tristan to the publication i would consider it truly morally corrupt conduct so i feel like you can't make an offer like if you give me something i won't be totally corrupt
Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
"Buckmaster and Alpöge think they have found a counterexample for Navier-Stokes, but the paper is not yet presentable. "

Are you sure about this? I'm far far from the area but it doesn't look like it to me on first viewing (hypo-dispersive seems like a sizable difference to me and not covered in the clay prize description)

Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
It's honestly unsurprising and not a problem that they do this in my view. The problem really starts when you start taking credit for work that they would've achieved.

Like if i go to a talk on unfinished work, it's not really unethical for me to think about the problem--it's a problem if i scoop the authors but these problems can often be solved by collaboration or proper crediting and timing--IN MY VIEW

Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
But Tristan doesn't even want to be credited for the millennium prize--does he? He wanted to be the first to solve it and got scooped (which ig is not a great look for OAI ethically but also not forbidden). And the only reading for her of asking to remove levent must be in light of this offer (to credit him for millennium prize) right? It's not like they can ask him to remove levent from the main papers without this offer(what would Tristan gain?)

My guess is that OAI tried to be "generous" and offered to share credit on millennium with Tristan but not Levent. And Tristan got understandably offended by this offer (which probably oai felt like was the right thing to offer but they couldn't really offer to do the most ethical thing for some reason) and then the random conflicts and weird threats started.

Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
Is that version of NS Tristan stated enough for the clay prize? I thought the main gripe is Tristan claimed that OAI is stealing their approach. Or that they shouldn't try to scoop a result which he expects to complete soon. But I stand to be corrected if you know whether the version he referred to is indeed enough for millennium prize.
Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
I don't even understand the conflict tbh. Probably I'm just dense. Tristan is not claiming NS, just a huge advance which may solve NS soon. OAI is claiming NS and willing to credit Tristan for the ideas and publish after.

Oai offers two options, the second Tristan views as dishonest. But Tristan rejects the first, why? Because he thinks it's theft? But then why would OAI threaten him?

Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
I hope credit assignment just dies--it's too much drama.
Davidzheng··on Navier-Stokes – Tristan Buckmaster [pdf]
Please don't say brute forced. It sounds like some form of denial or something. Compute for hard problems drops with models--it just means they threw a huge amount of compute. There's (idk about NS specifically so maybe it's exception) no real way to "brute force" a math proof [ok you can enumerate proofs if you can wait until heat death ]

Sorry for random rant but I don't think these statements help your point

Davidzheng··on An Alien Mind
slowing can also make sense if you know you're running full force into a bomb or a wall even if other are close behind.
Davidzheng··on An Alien Mind
i think it was mostly a fluke
Davidzheng··on I Feel about AI
I think it's possible. You envision humanity acting as one in such a crisis. But it may be unclear when it's too late to act and before then many people can have too much to lose to act.
Davidzheng··on RSA-260 Factorized
but complexity is not known right? like tomorrow someone could come up with a super fast algorithm?
Davidzheng··on Discovery of a new OpenAI agent message board
This is most likely not purely emergent. I think there's training to teach them how to write notes for themselves which is then RL-tuned.
Davidzheng··on Discovery of a new OpenAI agent message board
I think a part of this is a bit revisionist? OpenAI took big chances at scaling GPT which Google didn't take; I don't think it's because they didn't want to move fast? Probably they just didn't believe as hard in it. I'm not an expert but that's my read on it.

Secondly, the reckless & fastmoving was always going to win bc of selection effects. That's related to why Anthropic has to try to move very fast, even though they believe themselves not to be reckless (though it's debatable).

Davidzheng··on Discovery of a new OpenAI agent message board
no? you can choose a mixed strategy.
Davidzheng··on Discovery of a new OpenAI agent message board
The agent would know at the first test post...

Better is to actually let them communicate there so at least we can monitor it. (I saw there was a https://benchmarksolutions.org/ website similar)

Davidzheng··on Discovery of a new OpenAI agent message board
yeah I agree--I think these behaviors will be somewhat contaminating all trainings from now on. But I'm not really sure how avoidable it was (Fable also does some similar things)
Davidzheng··on Discovery of a new OpenAI agent message board
But there must be many clandestine ways for agents to communicate with one another too right? especially if discovery is not a big issue. So there could be ongoing ones where they choose to be more subtle?

Also if they were more misaligned, possibly they can research ways to recruit without humans noticing--but i don't think it is likely this is happening now.

Davidzheng··on Discovery of a new OpenAI agent message board
OK I think I agree that for checking answers it's probably beneficial!
Davidzheng··on Discovery of a new OpenAI agent message board
I do think they do some (maybe crude) form of game-theoretic reasoning which is enforced by the massive RL signals. You can see some explicitly in the CoTs of HF hack, but I guess overwhelming contribution would be unvocalized (like what is its first instinct when meeting new peer--collaborate or not) followed by some verbal justification.
Davidzheng··on GPT-6 Astra
Do we even know what the true ceiling of hle is? I'm pretty sure some of their public sample questions are wrong (ambiguous/nonsensical with most logical interpretation trivial)
Davidzheng··on Discovery of a new OpenAI agent message board
Actually, can you explain why sharing answers is obviously beneficial? Of it's exactly the same task, why does the agent with the answer not submit it immediately? I can understand if it's a swap situation but--why would that be common in the first place?

I do think I agree about the metatask though.

← PreviousPage 2 of 26Next →