HNHacker News
TopNewBestAskShowJobs

pcrh

3,181 karma · joined April 29, 2012

submissionscomments
pcrh··on A sleep-like consolidation mechanism for LLMs
Sleep-like states exist in animals with nervous systems with a complexity above that found in flatworms, even snails sleep. Sleep therefore appears to be an essential characteristic of more complex biological nervous systems, i.e. biological computers, should you care to stretch the analogy. The more complex the nervous system, the greater the requirement for sleep.

What is described in the OP is therefore not a specific characteristic of sleep. It may however be a "useful" rhetorical device.

I do however object to the extensive use of such rhetorical tricks in the conversations that surround LLMs. For example, why does a consumer-grade LLM display "thinking" while it is actually sending data from my computer to some datacentre, processing it, and sending the result back? Equally, why does it output human-emotive phrases such as "sorry" when such computation is revealed to be incorrect?

Such rhetorical tricks, and more, likely underlie to a large degree the popularity of LLMs, despite their actual performance being clearly below what the rhetoric implies.

pcrh··on A sleep-like consolidation mechanism for LLMs
The function of sleep in animals is largely obscure.

One thing we do know for certain is that it is necessary, it is needed in "dumb" animals as well as in you and I. If an animal can't sleep it will eventually die.

I don't think that applies to the activity described in the OP. Does their LLM "die" if it can't perform the function described?

pcrh··on A sleep-like consolidation mechanism for LLMs
I can't pretend to understand how LLMs work, but I can be sure that anthropomorphizing their functions is not helpful to an objective debate over their abilities.

Does a motor vehicle get "sleep" when it is serviced? When I reboot a computer, is that equivalent to a nap?

pcrh··on Princeton mandates proctoring for in-person exams, upending 133 year precedent
Mostly by requiring analysis and synthesis rather than memorization.

It's been some years for me so things might have changed, but no tech was allowed into the exam rooms, except for calculators in some subjects. Everything was done by pen and paper.

pcrh··on Princeton mandates proctoring for in-person exams, upending 133 year precedent
With reference to the "cultural" allusions of many posts in this thread, I can assure you that in the WASP UK universities of Oxford and Cambridge, all exams are "proctored".

It is assumed that students will attempt to cheat, so exams are designed so that cheating is not a viable strategy to obtain high grades. So-called invigilators also patrol the exam room and will report any violations.

pcrh··on Poland is now among the 20 largest economies. How it happened
Incomes in the former GDR are comparable to those of Poland. They still lag behind West Germany, however (as does Poland).
pcrh··on Egg Intake and the Incidence of Alzheimer's Disease in Adventist Health Study-2
The questionnaire included 200 food items. Within the study, 9 food categories are listed. No adjustment for multiple hypothesis testing is reported in the methods section.

We have to take it on faith that they did in fact specifically set out to determine if egg consumption was associated with Alzheimer's disease...

A quick search shows that other studies both do [0] and do not [1] link egg consumption with Alzheimer's disease.

[0] https://pubmed.ncbi.nlm.nih.gov/38782209/; https://pubmed.ncbi.nlm.nih.gov/31360988/

[1] https://pubmed.ncbi.nlm.nih.gov/28052883/; https://pubmed.ncbi.nlm.nih.gov/33561122/

pcrh··on Egg Intake and the Incidence of Alzheimer's Disease in Adventist Health Study-2
The source of funding is not the only suspicious thing...

From the actual study, which is free to read [0]:

>Dietary intake was assessed at baseline using a validated, self-administered FFQ that included >200 food items

So out of 200 potential associations, eggs were the winner? See this famous xkcd: Green jelly beans linked to acne.[1]

[0] https://www.sciencedirect.com/science/article/pii/S002231662...

[1] https://www.explainxkcd.com/wiki/index.php/882:_Significant

pcrh··on US–Indian space mission maps extreme subsidence in Mexico City
The San Joaqin Valley picture is astounding!

https://www.usgs.gov/media/images/land-subsidence-san-joaqui...

pcrh··on The first photo published in a newspaper
Those are impressive! It's worth noting that the photographic technology had advanced considerably between 1848 and 1906.

The exposure time of these kite photographs must have been quite short, given the obvious instability of the platform. They're very detailed, nonetheless.

pcrh··on US–Indian space mission maps extreme subsidence in Mexico City
The amount of subsidence is quite dramatic, up to 25 cm per year!

What are the practical consequences of this today, and what is being done to remedy this?

pcrh··on Why has there been so little progress on Alzheimer's disease?
Both meta-analyses above cover all eligible clinical trials for the respective strategies, targeting the GLP-1 receptor, or targeting amyloid.

For the GLP-1 strategy, Table 1 in the above paper shows that all drugs were clearly effective. Some were better than others.

For the amyloid strategy, only some of the drugs were effective, and that efficacy was very weak, even when all the drugs removed amyloid. This brings into question the hypothesis that removing amyloid would alleviate AD, i.e. the slender benefits of Lecanemab might not be caused by amyloid removal. The same cannot be said for the GLP-1 receptor agonists.

pcrh··on Why has there been so little progress on Alzheimer's disease?
If you grouped all GLP-1 agonists that had entered clinical trials, they would be shown as successful [0]. No GLP-1 receptor agonist has failed to reduce appetite in clinical trials, but some were better than others.

The point about the anti-amyloid trials is that they all succeeded in removing amyloid. But they did not improve cognition, and only some resulted in a slightly slower rate of decline in cognition (people still declined).

[0] https://pubmed.ncbi.nlm.nih.gov/39841962/

>Forty-seven RCTs were included, with a combined cohort of 23,244 patients. GLP-1 RAs demonstrated a mean weight reduction of -4.57 kg (95% CI -5.35 to -3.78), mean BMI reduction of -2.07 kg/m2 (95% CI -2.53 to -1.62), and mean waist circumference reduction of -4.55 cm (95% CI -5.72 to -3.38) compared with placebo.

pcrh··on Why has there been so little progress on Alzheimer's disease?
All the trials included in the Cochrane review demonstrated removal of Aβ amyloid from the brain. Side effects were relatively modest, except for edema and micro-bleeds. So they are all legitimate tests of the hypothesis that removing Aβ amyloid would be beneficial.
pcrh··on Why has there been so little progress on Alzheimer's disease?
The first GLP-1 receptor agonist to enter clinical trials was exenatide by Amylin Pharmaceuticals. It worked from the get go.
pcrh··on Why has there been so little progress on Alzheimer's disease?
The Cochrane review did not ask the question of whether Lecanemab (for example) worked, it asked the more general question of whether targeting amyloid worked. If targeting amyloid, generally, worked you might expect all approaches to targeting amyloid to show some efficacy. So they included all those for which clinical trials had been conducted. Obviously some treatments didn't pass the threshold required and so were not subsequently approved. If you only included successful trials you would bias the outcome.

It's possible, of course, that some methods of targeting amyloid might work where others failed. But even those that claim success (Donanemab and Lecanemab) have a very modest benefit.

pcrh··on Why has there been so little progress on Alzheimer's disease?
The question asked in the Cochrane review linked to above is whether there is evidence that current treatments targeting amyloid provide relief. Their conclusion is that the effect is too small to be considered beneficial. Especially when considering the undoubted side-effects, which include edema and micro-bleeding in the brain.

It doesn't ask whether amyloid is causative of the disease.

pcrh··on Why has there been so little progress on Alzheimer's disease?
Agreed, using these anti-amyloid treatments at an early stage in people with a high risk of early onset Alzheimer's disease, such as those with Down's syndrome, is likely the most robust test available of the theory that Aβ amyloid is directly causative of this disease.

Trials are currently ongoing. The results should start trickling out in a few years...

pcrh··on Why has there been so little progress on Alzheimer's disease?
The point of systematic reviews is to be un-biased. So if their question is whether targeting Aβ amyloid is a valid approach they have to include the unsuccessful trails as well as those purported to be successful.

As to the trials specifically for Lecanemab and Donanemab, the benefits are not claimed to be either strong or large, even by those who support it. The current support these receive is more aligned with the concept that an improved targeting of Aβ amyloid might improve outcomes. This remains to be demonstrated.

pcrh··on Why has there been so little progress on Alzheimer's disease?
Unfortunately the evidence that targeting amyloid (e.g. Lecanemab and Donanemab) improves the symptoms of Alzheimer's disease is very weak. See the latest systematic review [0]. This does not mean however that amyloid plays no role in the disease, the treatment may simply be too late.

[0] https://www.cochrane.org/evidence/CD016297_are-medicines-ant...

pcrh··on Why has there been so little progress on Alzheimer's disease?
Unable to read the full article, however the amyloid hypothesis is not without solid scientific foundations.

Alzheimer's disease may occur either due to inherited mutations in the genes for APP or presenilin, in which case it can occur as young as 40 yrs old. Or it may occur "sporadically" in those over 65yrs old. The brain pathology of both is similar. Notably, amyloid is derived from APP in part by the action of presenilin, which cuts the APP protein to release the amyloid peptide (Aβ).

Currently, the amyloid hypothesis is the only known way to reconcile the similarity of pathology (for both amyloid and tau) between early onset inherited AD caused by mutations in either APP or presenilin, and later onset sporadic disease. Furthermore, all the mutations in APP that cause Alzheimer's disease are located within or adjacent to the region that corresponds to Aβ amyloid, and not in the remaining 95% of the molecule.

Until another way of unifying these observations is found, the amyloid hypothesis will always find supporters.

pcrh··on Oxford All Souls College General Examination (2025) [pdf]
All Souls College doesn't have any students, graduate or otherwise. It's primarily a place where people can conduct research into any topic, most often in the humanities.

It frequently hosts journalists, politicians, lawyers, etc, who have had successful careers outside of academia and who may have no academic qualifications other than an undergraduate degree, and sometimes no degree at all.

pcrh··on Bodega cats of New York
It's still a problem in 2206?
pcrh··on A Periodic Map of Cheese
It's missing the characteristic element of a periodic table, which is both a visual and explanatory representation of the relationship between the composition of the different substances and their properties.

The concept is there, but it is presented as a regular table, not the classical periodic table.

The notion of "missing e̶l̶e̶m̶e̶n̶t̶s̶ cheeses" is entertaining, and the only real reference to the actual periodic table.

pcrh··on Isaac Asimov: The Last Question (1956)
Alternate source for the comic:

https://www.behance.net/gallery/102075221/The-Last-Question

pcrh··on US appeals court declares 158-year-old home distilling ban unconstitutional
I was replying to the statement that "alcohol is always poisonous". It isn't.
pcrh··on US appeals court declares 158-year-old home distilling ban unconstitutional
Ethanol is a naturally occurring substance, humans and many animals have specifically evolved ways of processing it. In moderate doses it does no harm.

It's almost impossible to avoid ingesting some alcohol during the course of a natural diet, and that includes if you avoid fermented food such as bread, let alone beverages deliberately brewed to be alcoholic.

pcrh··on What life looks like on the most remote inhabited island
Thanks!

An interesting article. It mentions that "breeding dogs are no longer allowed on the island". I presume this is to avoid a feral population of dogs becoming established. However, I'm unaware that dogs pose particular threats to native wildlife, unlike cats.

pcrh··on The EU still wants to scan your private messages and photos
Exactly. EU legislation is currently far more respecting of privacy than is legislation in the UK or the US.

For various, and unclear, reasons, there is substantial backing to change this.

pcrh··on Iran launched unsuccessful attack on UK's Diego Garcia
I'm suspicious as well...

Supposedly this missile was hit during the boost phase over Iran, the evidence is that it was actually targeted at Diego Garcia relies on US reports.

← PreviousPage 3 of 34Next →