HNHacker News
TopNewBestAskShowJobs

Paracompact

926 karma · joined September 12, 2022

submissionscomments
Paracompact··on Gemini 4 Argon
I am an expert (in formal methods). LLMs absolutely need more safeguards rather than less. Not because they /need/ them in order to produce functioning code, or even because they produce as many braindead bugs as humans, but because in an era of explosive code quantity, what has become valuable is (assured) code quality.

Going back to C++ would be particularly bizarre to me given that AI is also very proficient at verified languages. Not merely typesafe, but languages comprising their own spec languages such as Rocq and Lean.

I predict that in the next decade: (1) the market will understand the difference between a "code writer" and a "spec writer," with (2) the expectation that the latter is overwhelmingly more necessary than the former in an AI-dominated field, and (3) there will emerge more useful and less mathematically specialized formal verification alternatives to Rocq and Lean, and a filling-out of the tooling gap of between "static typing" and "interactive proof assistant," perhaps in the vein of ACSL-like contract annotations, and (4) there will be a subsequent shift in the traditional curriculum for programmers. Since educational change is slow (and spec writing depends on good coding fundamentals anyway), perhaps (4) is a stretch, but I'm more confident in the first three.

Paracompact··on GitHub has not removed malicious imitation software after 3 weeks
> They have more of an obligation to make money for their investors than they do anything else, that's just how it works

Where does this myth come from, and how does it survive? It's either an excuse for parasitic corporatism, or an expression of learned helplessness. Nobody has been successfully sued for prioritizing the long-term health and reputation of a company over self-starving quarterly profit.

Is there a perverse incentive toward the latter anyway? Yes. But it mostly serves current leadership, who are evaluated and paid on short horizons, at the expense of the long-term investors who own most of the equity.

Paracompact··on Claude discovers a novel enzyme system with CRISPR-like repeats
A model of lambda calculus with a much smaller Kolmogorov complexity, then.
Paracompact··on Grok 4.7
Elon's mother recently posted an AI-generated photo of her son's birthday party. The tag indicating such was scrubbed as soon as it was pointed out.
Paracompact··on If math is more than proof, we need to better celebrate the rest of it
> Anyone who is even quite intelligent but has really pursued the rigorous stuff, unless they are in fact a prodigy, eventually realizes they have an abstraction ceiling

Eh. I'm a math PhD who fled academia because it was too much for me. But I have never encountered this term "abstraction ceiling" nor did I succumb to it. I simply ran out of motivation to pursue higher math, especially when following through on learning and research became more and more labor. (It was always labor; but it was a labor I used to love.) I am far from a prodigy.

> even epsilon-delta proofs are enough to eliminate the majority of the population, no matter how good a teacher you are

Disagree. It's a notoriously hard subject to teach, and with all the demands placed on e-d in so little time in your average curriculum, it doesn't require appeals to IQ to explain its infamy. With enough motivation and practice, the quantifier alternation is comprehensible to any sound mind. What your average mind (and student) lacks is exposure to formalism, abstraction, and how these things tie in with what they are familiar with, which is symbolic manipulation. With the exception of geometric proofs (another educational bugbear), they have little context for what formalism is or why it matters.

Paracompact··on If math is more than proof, we need to better celebrate the rest of it
Another response to math that makes me sad: "I must be too stupid to understand this," "my brain is too small for this," etc. Different people say it for different reasons, but it's almost always in response to a hand-wavey explanation that doesn't makes sense to anyone not already in the know. Math is so much more about humility and skepticism than it is prodigy.
Paracompact··on How do we prevent mathemathics from devolving into the Medieval Era of secrecy?
If there is any barrier, it is not intentional, I assure you. Math is just hard.
Paracompact··on Backups Aren't Simple
"This is the business we've chosen."
Paracompact··on Navier-Stokes Announcement
It was trivial because the Collatz proof script is literally 1000x smaller than the script for Navier-Stokes and involves no advanced math. And they found the bug by... manually inspecting the proof script. Maybe we should do the same for Navier-Stokes before declaring the matter settled?

Not only that, but there is a very fuzzable tell of something funny in the Collatz proof script (`CommandElabM`, i.e. metaprogramming). We may not at all be so lucky in other malicious scripts, especially if there are still kernel-level bugs in Lean.

Paracompact··on Everyone should slow down AI development except for me
Good regulations would be very nice! Mandatory transparency into training and dataset usage would be a benefit for all, for example. Some sort of regulation or incentives against the most corrosive enshittification (AI call centers, AI therapists, undisclosed AI entertainment mills, etc.) would also be an overwhelmingly popular proposition. And enforcement of the CFAA on operators who let malicious agents loose onto the open internet, or otherwise consume too many resources or violate robots.txt, might at least help the internet stay alive a little longer.
Paracompact··on Everyone should slow down AI development except for me
It's not all-or-nothing. Banning Chinese models in the public sector and strong-arming the private sector against using them would already do great damage. Similarly, open-source training could be stymied by any of hardware embargoes, taxation, or regulation of larger players.
Paracompact··on Everyone should slow down AI development except for me
https://en.wikipedia.org/wiki/Regulatory_capture

The fear is not that they will just slow down progress for all. It is that regulation will specifically burden competition. If you kill open-source training, ban Chinese models, crack down on self-hosting, grandfather OpenAI/Anthropic/Google into regulatory compliance while throwing the book at startups, etc. you wind up in the worst of all possible worlds.

Paracompact··on Navier-Stokes Announcement
The point is, they "proved" the Collatz conjecture. You would not know they exploited a bug unless you actually went and dug into their proof. Can we be so certain this has not happened within the millions of lines of Navier-Stokes? In an ideal world, our proof assistants would be more battle-hardened by now (recent exploits deny this), our AI better aligned (their tendency to cheat at tests denies this), or their handlers more responsible (the Hugging Face incident denies this), but the reality is more complicated.

At this point in time, we really can't be confident in accepting proof certificates without any human eyes on the script that generated it. I still have 95%+ confidence in this particular result being trustworthy, but a precedent of blind faith is guaranteed to end badly.

Paracompact··on Navier-Stokes Announcement
https://leodemoura.github.io/blog/2026-8-1-postmortem-for-ke...

Do you believe no open questions remain as to the truth of the Collatz conjecture?

Paracompact··on Navier-Stokes Announcement
AI has autonomously found (many) proofs of False in Lean and Rocq, so it's not merely a theoretical concern. A misaligned AI agent tasked with proving the near-impossible just might wind up smuggling in a bug deep in a lemma somewhere (anyone remember the days back when AI routinely made tests pass by "fixing" the tests?). That said, I doubt OpenAI would be so foolish as to not do a cursory vetting of the proof for malicious compliance, so the actual odds are probably pretty low.
Paracompact··on Navier-Stokes Announcement
First of all, that is Fermat's Last Theorem, not Navier-Stokes.

Second of all, you did not read the link.

> In particular, we use honest when the goal is to create a valid proof. This allows for mistakes and bugs in proofs and meta-code (tactics, attributes, commands, etc.), but not for code that clearly only serves to circumvent the system (such as using the debug.skipKernelTC).

Given that AI has autonomously found proofs of `False` in Lean and other proof assistants, it is far from impossible that such a circumvention could be present somewhere in 13 million lines.

Paracompact··on OpenAI’s Navier-Stokes release included a Lean 4 formal proof
With less confidence, yes. If anything, scaling detriments exceed the scaling benefits when it comes to large formalizations.
Paracompact··on OpenAI’s Navier-Stokes release included a Lean 4 formal proof
By formalizing, they mean within a proof assistant like Lean or Rocq, not simply in prose in a textbook. I can attest, 40 hours per page is by no means an overestimate for this sort of work.
Paracompact··on GPT-6 Astra, looped transformers, and hidden reasoning
Can you re-run some prompts that you ran on Monday and report the differences in output?
Paracompact··on Finding a bug in Dummit and Foote's Abstract Algebra
It warms my heart every time I see an interactive proof assistant being used to improve rather than simply slow down mathematical thinking.

After years of using the things, I believe not enough focus is given to high-velocity uses of proof assistants for prototyping. They can altogether replace scratch paper for fumbling around with new concepts.

Paracompact··on GPT-6 Astra
Origami design will be my personal test bed for the coming years.

It's objectively very difficult and technical, it's spatiovisual, it's artistic, learning resources for it are sparse and most just learn by the FAFO method, current AI sucks terribly at it, and it's not likely to ever be specifically targeted by benchmaxxers.

Paracompact··on GPT-6 Astra
Not OP but here's a problem just today:

I was using an AI to help me set up a container to be used as the Nix build environment for another AI. This build environment would not have Internet access. I was having it base its approach off a previous container used for a Stack build environment.

In its initial analysis of my proposed strategy, it insists as its premier point /against/ the strategy, "you will have to rebuild the container every time your flake.nix changes."

Two head-slapping errors of judgement in saying something like that:

(1) The Stack solution is identical. Change stack.yaml, the container must rebuild. (2) It is not physically possible to do better than this while insisting on an internet-free environment.

So on this point, it was just parroting advice irrelevant to the context at hand. LLMs always have such a bizarre mix of technical knowledge and lack of good judgment.

Paracompact··on Doctors are finally learning to manage antidepressant withdrawal
On an academic level, we have reined in much of the excess enthusiasm in antidepressants that was courtesy of 90s-era pharmaceutical reps and ad men, but I don't think this revision ever occurred in the cultural consciousness at large.
Paracompact··on Doctors are finally learning to manage antidepressant withdrawal
> Though this article concentrates on the SSRIs, other meds like the SNRIs can have a similar or even worse withdrawal effect.

And don't even get me started on tricyclics or MAOIs... no, seriously, don't get me started on them! The current generation of first-line antidepressants (SSRIs/SNRIs) might as well be free compared to the old school crazy pills.

Paracompact··on Mathematics in the age of AI
By this point, he is very much nutso enough that a Lean certified counterexample to his theories would not dissuade him. His response would be either that the formalization is incorrect (with no coherent insights on how to fix it), or worse, Lean itself is a tool of Western imperialism and incapable of properly explicating his ideas. He has, in the past, ranted against such things as monotheism and English grammar as being the reason for his theories' lack of popularity.

IIRC he has expressed support in the past for attempts to formalize IUT in Lean, but we'll see where that really goes, because he's absolutely not clearheaded enough to lead such a project himself.

Paracompact··on Manabu Kosaka's Handmade Paper Sculptures
These are exquisite. I wonder what drew this artist to this medium? What made him sit down and commit himself to such constraints? It certainly doesn't look like the kind of thing one does casually. Did it come to him in a dream? Did it evolve slowly as a pastime since boyhood? Did he think it would help him stand out from other sculptors?
Paracompact··on Companies promote incompetent employees to management to limit damage they do
Yeah, I think this is the most defensible steelman of the concept: Incompetent people aren't deliberately sought out for promotions, but there is a disincentive to promote some of the most competent people. Sometimes. For some very context-dependent notions of "(in)competent."
Paracompact··on The Amazon tax
Conscientiousness is incompatible with monotonicity of capability. That is:

1. We tend to believe "more power/knowledge/choices" is universally a good thing; that we are rational creatures in some sort of game theoretic landscape where we are free to optimize for our own outcomes, and extra options or information can only be to our optimization benefit.

2. We tend to believe that as moral agents, we have obligations to Good. More specifically, knowingly choosing against Good should in proportion produce Guilt.

The bind that results from (1)+(2) is distinctly Christian to me, obsessed as Christianity is with the notion of shame as a moral whip. It is an exercise in religionmaking how to structure one's psychological incentives so that solipsism is avoided while not sacrificing (1).

Paracompact··on How I over-engineered my book
Yours instantly! 576 pages!

It's so very clear why he thought it was a good idea to have a regex validator to check that he doesn't imply he still works at Github.

"i dont work at github"

"Yes, you're absolutely right. I apologize for the mistake and have edited the document accordingly.

reads War and Peace system prompt

Here is how we can programmatically and scientifically avoid this problem in the future:

1. Add to the regex validator library: We can add to the regex validator library an additional entry to catch any future instances of this mistake. This is a low-cost, high-yield approach---regex runs with deterministic and repeatable results, with the added benefit that its big-O runtime scales at most linearly with the size of the text for most use cases (Hartmann, 2018).

*Three other braindead ideas*

Which future-proofing strategy shall we take?"

"sure 1"

Paracompact··on Every Fucking Website (2020)
I am now very interested in the second and first dumbest smart people you have worked with. You can't keep us hanging!
← PreviousPage 2 of 11Next →