HNHacker News
TopNewBestAskShowJobs

michael_nielsen

8,027 karma · joined July 24, 2007

https://michaelnotebook.com
submissionscomments
michael_nielsen··on The Life and Science of Richard Feynman (1992)
I've heard that Murray Gell-Mann said of this book that "Jim Gleick has written a biography about Feynman's genius in order to illustrate his own". A bit backhanded, perhaps, but it captures the essence well: it's an extraordinary book about an extraordinary person. The best biography I've ever read, along with Skidelsky's one-volume Keynes.
michael_nielsen··on Geoffrey Hinton leaves Google and warns of danger ahead
He played key roles in the development of backprop, ReLU, LayerNorm, dropout, GPU-assisted deep learning, including AlexNet, was the mentor of OpenAI's Chief Scientist, and contributed many, many other things. These techniques are crucial for transformers, LLMs, generative image modelling, and many other modern applications of AI

Your post suggests that you know almost nothing about how modern deep learning originated.

michael_nielsen··on Misalignment Museum
You asked for examples of existing harms from AI misalignment, and now seem to define AI misalignment so that, by definition, it excludes all current systems. So tautologically the answer to your question will be "no".

Brian Christian's book "The Alignment Problem" contains many examples of harms from systems which people plausibly see as being based on precursor technology.

michael_nielsen··on I wish GPT4 had never happened
Your comment is amazing in its lack of empathy.

Everything you write can be true, and this can still be disastrous for some individual, whose life may be badly damaged.

michael_nielsen··on Steering wheel falls off a new Tesla Y while driving on a highway
I found this a surprisingly interesting discussion: https://en.wikipedia.org/wiki/Whataboutism

It includes many historical references, and an example from 1974 which may be the first use of the term; the definition given there (and throughout the article) is obviously applicable to modeless' original comment. It also includes a thoughtful defense of whataboutism, including rndmize's comment that sometimes it provides useful context.

michael_nielsen··on Steering wheel falls off a new Tesla Y while driving on a highway
It's textbook whataboutism.
michael_nielsen··on A look inside Feynman’s calculus notebook
Feynman said the first thing seriously in a superb in-depth interview with the historian Charles Weiner. The second is a facetious quote from someone else (Murray Gell-Mann, who seemed rather irritated with the question, as I recall).

As far as I can tell, most theoretical physicists: (a) can do a surprising amount in their head, especially when deeply familiar with a problem; and (b) have their ability greatly expanded when working on paper or with some other external aid (whiteboard etc).

Source: worked as a theoretical physicist for ~13 years. On a few occasions I solved publishable problems in my head, though usually after a lot of immersion in conversation and on paper first, just getting familiar with the problem, but (superficially) making little progress. More often, though, serious work involved a lot of exploration using external aids. I haven't done a poll of other theoretical physicists, but based on informal conversations wouldn't be surprised if many have a similar experience, with considerable variation.

Update: the Gell-Mann comment is here: https://www.nytimes.com/1992/09/20/magazine/part-showman-all... My interpretation is that he's being facetious, but with a grain of truth - a habit research students sometimes need to break is when they rely too much on methods as a crutch. Sometimes, no method will work, you just need to think really hard and try lots of things.

michael_nielsen··on How safe are nuclear power plants?
You evidently didn't read the article.
michael_nielsen··on Blogging with Org-mode for lazy people
Curious: does anyone use this? As far as I can tell the Readme contains no pointers to anyone using the software.
michael_nielsen··on What does it mean to listen on a port?
No worries. I'm glad you're experimenting!

For myself - and I know others respond very differently - I usually want everything in an essay to serve the overarching point. So I find fictional asides pretty distracting. There are exceptions: Imre Lakatos did it well in "Proofs and Refutations", and Douglas Adams did it well too. But it's tough to pull off!

michael_nielsen··on What does it mean to listen on a port?
As others have pointed out (e.g.: https://news.ycombinator.com/item?id=30324567 ), the style in this article is not what I had in mind when I coined the phrase "discovery fiction". It also has nothing to do with spaced repetition or having a "more natural flow".
michael_nielsen··on The Banality of Genius: Notes on Peter Jackson's Get Back
When I read it I presumed he was using anomie in the sense of Durkheim, usually taken to mean a kind of listlessness or alienation, from one's work and society. I really like: "the anomie and the ecstasy are inseparable".
michael_nielsen··on The Banality of Genius: Notes on Peter Jackson's Get Back
They seemed fine to me. If I was his editor I'd have changed encomium, but it's not terrible. Anomie and Antipodean seem well used. In particular, I enjoyed and found thought-provoking his replacement of the cliche "agony and the ecstasy" by "anomie and the ecstasy". I've no strong opinion on recce, which is not a word I regularly use.
michael_nielsen··on How to read research paper, textbook, long text content?
Right - if the paper is really good, it might take a few years to understand.

Most papers can be read in < 10 seconds ("not interesting, next"). Most pretty good papers can be read in 5-10 minutes. Very good papers might take a few hours. And so on.

I'm caricaturing, but only a tiny bit, this is how I read. And for good stuff, that I want to understand, a page an hour is (often) pretty typical for my first fairly thorough read.

I've written two textbooks, and in both cases I thought of the book as the distilled outcome from reading about a dozen very important papers really thoroughly

michael_nielsen··on The Mind of a Mathematician
This seems like a thoroughly detestable use of HN: a gratuitous, mean, and almost certainly uninformed (you spelled his name incorrectly) judgement of another human being as "overrated" or "underrated". Why not use your time to do something worthwhile?
michael_nielsen··on How can we develop transformative tools for thought?
Thanks, no worries. Sorry to hear you're feeling a bit fed up with Anki / parts of Med School.
michael_nielsen··on How can we develop transformative tools for thought?
Glad you like my work. To quote the essay:

"these kinds of results should be taken with a grain of salt. The mnemonic medium is in its early days, has many deficiencies, and needs improvement in many ways... is this medium really working? What effect is it actually having on people? ... are there blockers that make this an irredeemably bad or at best mediocre idea? How important a role does memory play in cognition, anyway?"

The essay continues at great length in this vein, getting gradually into more and more detail. We have detailed discussion of common ways spaced repetition fails, of ways it may inevitably fail or needs to be redesigned (a different issue), of ways it falls short of the goal of understanding, of ways spaced repetition is a poor lens for memory systems, and so on. I haven't counted, but believe there's several thousand words in this vein.

The conclusion is that: (a) we are some ways from having really good memory systems; but if we did it would (b) likely to be extremely helpful, including in lots of ways people don't commonly appreciate; and (c) be far from a panacea. The essay has a lengthy discussion of points (a) and (c), in addition to (b).

I don't think it's reasonably characterized as hype.

michael_nielsen··on Patrick Collison on Innovation and Scientific Progress [audio]
The transcript appears to be "highlights" (i.e., excerpts with gaps between), and so it wouldn't be surprising if it jumps around.
michael_nielsen··on Using spaced repetition systems to see through a piece of mathematics
Glad you enjoyed the essays. On LaTeX - I sometimes cut-and-paste screenshots, but usually just write raw LaTeX or pseudo-LaTeX (i.e., something LaTeX-like that wouldn't compile, but is easier to read). It'd be much, much better to use some kind of plugin that turned it into images, but I've been too lazy to try.

This has, incidentally, made many of my matrix-based Anki cards rather ugly. I'll probably update a bunch of answers with cut-and-paste from this essay.

Not to put too fine a point on it, but it's pretty bad I'm using raw LaTeX in this way - I'm sure it hurts my understanding! On the other hand, I've written so much LaTeX over the years that reading it seems really natural.

michael_nielsen··on Using spaced repetition systems to see through a piece of mathematics
I mean diagonalizable by a unitary matrix. Fixed.
michael_nielsen··on The Era of Quantum Computing Is Here. Outlook: Cloudy
Not quite true. I can think of two well funded people in 1995-2000 who either believed (or implied to funders) that scalable quantum computing was plausible within 10 years. But those people were outliers. You're correct that it was an uncommon view, and mainstream consensus in the field was that it was many decades away. The situation today is certainly very different, and people seem much more optimistic.
michael_nielsen··on Chalktalk – A digital presentation and communication language
It does. It also works in VR.
michael_nielsen··on Chalktalk – A digital presentation and communication language
Yes. Chalktalk was the main inspiration for that project.
michael_nielsen··on Spaced repetition
One of the most cited papers in the area is Frank Dempster's paper about the failure of educational systems to adopt spaced repetition: http://andrewvs.blogs.com/usu/files/the_spacing_effect.pdf Although the paper was was written almost 30 years, little has changed.
michael_nielsen··on Andrew Wiles: what does it feel like to do maths?
The first two minutes are absolutely extraordinary, both for the insight, and for the emotion revealed.
michael_nielsen··on Crocker's rules
Its descendant lives on: http://lists.extropy.org/pipermail/extropy-chat/
michael_nielsen··on The Dark Energy of a Theoretical Physicist
(1) Einstein's Nobel citation specifically mentions his work on the photoelectric effect, not his work on Brownian motion; (2) his work on Brownian motion was theoretical, not experimental; (3) there have been many Nobels for theoretical work --- all three of the 2016 Laureates, and both the 2013 Laureates, to pick some recent examples.
michael_nielsen··on What were Einstein and Gödel talking about? (2005)
According to Amazon (not always reliable) that book came out in September 2005. The New Yorker article is from February 2005. Suggests the sourcing may be the other way around.
michael_nielsen··on Thiel shows why tech billionaires are the new robber barons
Following that rabbit hole, the author seems to be this person: http://www.startegix.com/about.html

The first five things in the list of things his company does are: "Public Relations, Media Relations, Press Material Creation, Marketing Communications, Brand Positioning".

It appears that Reuters is running unmarked advertising for Gawker or some other client with similar interests. Lovely.

michael_nielsen··on Alan Kay's reading list
It's not a depth limit. Rather, mods noticed that many deep threads were flame wars, and implemented a short delay before you can post in deep threads. At least, that's my understanding.

To see replies, click on "Threads" at the top of the page. I don't know if there is any standard way of getting an email notification.

← PreviousPage 2 of 17Next →