HNHacker News
TopNewBestAskShowJobs

earthicus

668 karma · joined July 28, 2018

submissionscomments
earthicus··on Why is Maxwell's theory so hard to understand? (2007) [pdf]
Maxwell explicitly uses the imaginary part of a quaternion as a model of vectors, just as Hamilton did:

> A german letter denotes a Hamilton vector, and indicates not only its magnitude but its direction. The constituents of a vector are denoted with roman or Greek letters. [1]

Gibbs and Heaviside or course use a different algebraic model of vectors, which is the one used in introductory courses now. But the more significant change made to get to "maxwells equations" as we know them now is not a slight change in the mathematical formalism.

The big difference is a change in the underlying physical model: Maxwell's original treatment is largely in terms of potentials, which Heaviside modified to focus on the E-M force fields directly. This change is what gives the familiar four equations we know today, not fiddling with your parameterization of the rotation group, or similar games. Nowadays physicists frequently use a tensor or forms model of vectors in addition to the gibbs model.

[1] https://archive.org/details/ATreatiseOnElectricityMagnetism-...

earthicus··on Why is Maxwell's theory so hard to understand? (2007) [pdf]
This is something of a myth. Maxwell actually uses both to ease the mathematical pain for his readers - he writes the equations out coordinate by coordinate, and he also compresses them using Hamilton's (quaternion) model of vectors. In fact Maxwell was the one who introduced the gradient, curl, and divergence (actually he used convergence) operators, and he addressed precisely your concern in his book by giving both formulations!
earthicus··on Ask HN: What tech talk does everyone need to see?
I really enjoyed the 'Four Algorithmic Journeys' Lecture series by Stepanov. (actually theres only 3 journeys) It is a combination of teaching your some basics of developing (generic) Algorithms, basic abstract algebra, and some (not always super accurate) history of mathematics.

1. The first journey starts with an ancient Egyptian multiplication algorithm. When we think about what is required for it to work, we are immediately lead to the axioms of a semi-group, and various examples are considered.

2. The second journey starts with division, and then Euclid GCD algorithm. We extend it to polynomials and beyond, and are led to the definition of a ring & euclidean domain. A surprising application to permutation algorithms is given as well!

3. The third journey is about the peano axioms and has a bit of logic and compatibility theory, then the peano axioms are weakened a bit to produce the notion of an iterator from programming.

Abstract algebra really seems like a much more relevant 'mathematics of everyday programming' than the usual subject CS students take, which seem to appear in domain specific technical work. By contrast, abstract algebra is to some extent elementary arithmetic and algebra, but extended to non-numerical data, of the kind that appears all time in general-purpose computing.

https://www.youtube.com/user/A9Videos/playlists

earthicus··on The Erdos Paradox
Here's an old post by terry tao explaining why the collatz conjecture is hard, and giving a heuristic argument that it's unlikely to be solved with purely elementary techniques. The essay is surely worth reading if you want to make an attempt on that problem!

https://terrytao.wordpress.com/2011/08/25/the-collatz-conjec...

earthicus··on How Alan Turing Deciphered Shark Skin
I think it wasn't just limited to turing! Several of the pioneers of mathematical computing showed astonishing foresight about how farreaching this new theory was. For example, here's Sydney Brenner talking about how much von Neumann understood about self-replication by 1950:

https://www.youtube.com/watch?v=5Ictxz1XCiY

earthicus··on How Space and Time Could Be a Quantum Error-Correcting Code
I'd also like to recommend the semi-technical talks by Nima Arkani-Hamed and Leonard Susskind. They are the only reason I have the faintest hint of what is going on in theoretical physics and cosmology.
earthicus··on Adding a Trackpoint to an Inexpensive Mechanical Keyboard
Does anybody know if there's been a keyboard with dual trackpoints, analogous to dual joysticks on game controllers? I'm almost certain this is whats required for precision mousing.

A software controller might look like this: one nub would move a modest sized circle (playing the roll of the hand) quickly around the screen, while the other would make precision movements within that region (playing the roll of fingers), snapping to clickable regions.

earthicus··on Algorithms, by Jeff Erickson
Here's an old mathematical perspective that treats dynamic programming as analogous to the calculus of variations. Very different from a how it's usually talked about, I think. I haven't read much of it, but perhaps the change in perspective will be helpful to you:

https://www.rand.org/content/dam/rand/pubs/reports/2006/R441...

earthicus··on An introduction to Georg Cantor’s transfinite paradise
Referring to properties of linear operators. Examples are finiteness, surjectivity, non-negativity, monotonicity, min/max principles, contraction properties, etc.
earthicus··on An introduction to Georg Cantor’s transfinite paradise
I suspect your professor was referring to 'qualitative' vs 'quantitative' approaches when referring to soft vs hard analysis. The baire category theorem is intimately related to these to approaches, and leads to three theorems (1) the uniform boundedness principle, (2) the open mapping theorem, and (3) the closed graph theorem, that establish equivalences between the qualitative and quantitative theories.

According to Tao's textbook, in practice these are not used much directly, instead one starts with quantitative bounds, then derives the qualitative corollaries. The baire category theorem tells us why those there theorems are true, and thus tells us why we can take that step from quantitative to qualitative. I think this is what your professor meant.

earthicus··on An introduction to Georg Cantor’s transfinite paradise
a baire category is an old-timey synonym for a baire space. It's related to topology & analysis, not algebra (like category theory). In the modern theory we can make an analogy (but it is just an analogy!) between 'categories' of (complete non-empty) metric spaces on the one hand, and measure spaces (of positive measure) on the other, as follows:

  metric spaces:    measure spaces:

  first category    zero measure
  second category   positive measure
  residual          full measure
  baire             measurable
earthicus··on Best Paper Awards in Computer Science since 1996
Well i think it just depends on how 'significant' you need the phd to be. As an example of what I mean, consider the first issue of this years Annals of mathematics [1] and note that there is not a single grad student on any of the papers, first author or otherwise.

[1] http://annals.math.princeton.edu/2018/188-1

earthicus··on A Tribute to Euler (2008) [video]
You don't need nonstandard analysis to make differentials concrete - Cauchy showed us how to model them with ordinary variables, and this method is taught in standard undergrad textbooks like Stewart.

The issue i was bringing up is that the early use of differentials does not correspond to this. The algebraic models of differentials presented in Cauchy or Robinson's nonstandard analysis is not the same thing as the algebraic models used in Euler. The book i suggested uses differentials from beginning to end, but uses the modern, correct form that doesn't lead one to wrong answers when manipulated with standard algebraic rules. There is absolutely no reason to go back in time and inflict this confusion on yourself by intentionally unlearning the hard-won right answer.

Although I should point out that Archimedes correctly understood how to compare different orders of infinitesimals in his book 'On Spirals' (via tangents), circa 200 BCE! Wow!!!

earthicus··on Best Paper Awards in Computer Science since 1996
I specifically made that claim of mathematics and theoretical physics, and requested first hand accounts of how it worked in CS.
earthicus··on Best Paper Awards in Computer Science since 1996
Is that really how research in CS works? Certainly we hear about grad students doing lots of the work in laboratory sciences like biology, but in more analytic subjects like mathematics or theoretical physics its not true at all. Grad students making significant contributions is extremely rare; basically all of the real research is done by tenured professors.

Can those of you who did postgrad CS tell us how much of the research is actually done by grad students vs professors?

earthicus··on A Tribute to Euler (2008) [video]
In Euler's time they still didn't have a correct understanding of higher order differentials, so the work from this time period has genuine errors that you would need to be aware of. Might I suggest an alternative? There's a wonderful little book by Nathanial Grossman called 'The Sheer Joy of Celestial Mechanics' [1]. It assumes vector calculus of course but otherwise might be just what you're looking for. From a prepublication review:

> Don't look for axioms to memorize. Too many courses are consecrated to teaching students to play chords on a set of axioms. This book celebrates the heroic age of calculus, the time of Euler, Maclaurin, Clairault, Lagrange, and Laplace, a time before delta and epsilon. [...] mathematics was invented to do things, not just to be talked about, and today - still - its greatest triumphs are what it can do.

[1] https://www.amazon.com/Sheer-Joy-Celestial-Mechanics-dp-0817...

earthicus··on Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
If a coordinates are given, then they will be given with respect to a basis. However, it's entirely possible to do things more abstractly without introducing coordinates and bases to begin with, for example:

https://en.wikipedia.org/wiki/Tensor_(intrinsic_definition)

earthicus··on Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
Aha, yes. Computer languages borrowed the word 'vector', but they have basically nothing to do with the mathematical structure from linear algebra. It's best to keep them completely separate in your mind.
earthicus··on An Illustrated Theory of Numbers (2017)
Thanks for stopping by! I'd like to ask a question / make a request. Unlike most of the people here, I was trained in mathematics but am just learning how to program, so I was wondering if you had any desire to expand the online algorithms material. In particular the 'generic programming' technique illustrated by Alexander Stepanov in these lectures (Four Algorithmic Journeys) [1] and book [2] caught my attention. He takes a simple number theoretic algorithm, considers what properties are required for it to work, then generalizes it and applies it in other useful and surprising cases.

For example, Stepanov starts with the problem of multiplying two integers n * m using the Ancient Egyptian Multiplication algorithm from the Rhind Papyrus (which runs in log n if i remember correctly), then observes the only property needed for the algorithm is associativity, so that it can run on any semi-group: mult(n,s) is n repetitions of the semi-group element s, using the semi-group operation. Useful and surprising applications are (1) matrix exponentiation to solve systems of linear recurrences in log n steps (no stupid Fibonacci implementation here!), and (2) encode a graph in your matrix, with elements in a tropical semi-ring, then matrix exponentiation solves shortest path. Not too bad for a 4,000 year old multiplication algorithm.

A second example is the euclidean algorithm, which he extends first to polynomials following Stevin, then to Gaussian integers, then to euclidean domains. A surprising application was to permutation algorithms managing memory.

Anyhow, I think it would be really cool if you showed these kind of applications of number-theoretic algorithms as well as the cryptography stuff. Unfortunately basically all of the modern algorithms literature seems to avoid even the tiniest hint of abstraction; it makes the subject so much harder to hold in your head! So providing a new set of examples that is more accessible than Stepanov would be doing the world a great service, i think.

[1] https://www.youtube.com/user/A9Videos/playlists

[2] https://www.amazon.com/Elements-Programming-Alexander-Stepan...

earthicus··on An Illustrated Theory of Numbers (2017)
I should probably point out the prerequisites. You need to know basic multivariable calculus, and basic matrix algebra.
earthicus··on An Illustrated Theory of Numbers (2017)
Polya & Velleman are classics. They're about problem solving & proof writing techniques, but won't teach you any abstract math. I've only ever heard good things but i've actually never read them myself! Some other suggestions:

Niven - The Theory of Numbers. Contains hints for some of the proof based exercises, and answers for many of the computational exercises. I used it for my undergrad course, I remember it being reasonably beginner friendly.

Pressley - Elementary Differential Geometry. Has terse answers to every exercise! The subject is a nice mixture of concrete and abstract, calculation and proofs, and there's some interesting work using differential geometry in CS via computational geometry. Also i think it's used in robotics and a few other things? This book is very beginner friendly, it will get you about 1/2 way to General Relativity.

earthicus··on An Illustrated Theory of Numbers (2017)
Sample Chapter (pdf): https://bookstore.ams.org/mbk-105/~~FreeAttachments/mbk-105-...
earthicus··on Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
Yes, the keyword here is 'basis'. You represent a vector by giving two pieces of data, (1) an ordered list of coordinates, and (2) a basis. The vector is then a linear combination of the basis elements, and the coordinates tell you how to form that linear combination.

For example, let's use the standard Cartesian basis consisting of unit vectors e1, e2, e3 (which point north, east, and up, informally speaking). If our vector v is given by the coordinates (3,4,8) (with respect to the standard basis), then this means that v = 3 * e1 + 4 * e2 + 8 * e3.

If the coordinates were given with respect to a different set of basis vectors, then you would take the linear combination using those vectors instead. Note the similarity of how a basis works to how a base system works representing numbers. Using base 10, the 'coordinates' of the number 348 mean that 348 = 3 * 100 + 4 * 10 + 8 * 1. Using a different base, say base 9, they would instead mean 348 = 3 * 81 + 4 * 9 + 8 * 1.

earthicus··on An Illustrated Theory of Numbers (2017)
I'm submitting this beautiful book right now because the American Mathematical Society (AMS) is having a large sale, it's 40% off until the 17th. (You have to make an AMS account).

Table of contents (pdf): https://bookstore.ams.org/mbk-105/~~FreeAttachments/mbk-105-...

Sample Chapter (pdf): https://bookstore.ams.org/mbk-105/~~FreeAttachments/mbk-105-...

earthicus··on Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
One difficulty students had that I encountered as a TA was some garbled prerequisites. All of the epsilon-delta definitions are written in propositional logic, and are often '2nd order statements', (that is they have nested quantifiers). This is an entirely new formal language, and its usage is very different than english. It needs to be carefully explained, but standard texts like Stewart just dress it up to look kind of like english and carry on.

In fact the mathematics curriculum DOES acknowledge that you have to teach most students this if you want them to understand it: at my university it lived in the discrete math course, which used Rosen. He devotes an entire chapter on propositional logic, and spends literally 60 pages gradually building up the complexity to arbitrary nested quantifiers; the definition of the limit appears at the end of this.

Unfortunately, discrete math also makes heavy use of sequences and series, so that Calc 2 is a prerequisite of the course... thus my program's student-victims would spend a year taking calculus and not understanding much of the formalism before they were even allowed to take the course that explained the language the basic definitions of calculus were written in! Ugh.

I think Stewart and Rosen are pretty mainstream textbooks, so i suspect this problem is very common. Perhaps you could point it out at your next faculty meeting and shuffle some prerequisites around; we'll start a math-revolution! :)

earthicus··on Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
Page after page of mathematical insights and delights! I've never had the opportunity to work through it systematically, but have frequently read excerpts and have never been let down. I would expect nothing less from a figure so great as Lax!

It's worth pointing out in the context of this discussion that the book is, by the author's own design, not an introduction to linear algebra. It is a second course that Lax used to teach his advanced undergraduates and beginning graduate students at the Courant Institute. For example, OP with a high school math background will surely be very puzzled by page two, when a linear space is defined as a field 'acting on' a group. Which is, i think, the 'right' way of thinking about the algebraic structure, in the sense that it greatly simplifies all the intricate moving parts of linear algebra. Anyhow, I second your recommendation!

earthicus··on Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
There's no issue with the notation; I think you've misunderstood the mathematical idea. Consider a more familiar algebraic object, a real number, x. This can model a length, an area, volume, time, time interval, temperature, weight, speed, physical constant, geometric ratio, fractional dimension, etc...

In mathematics, we abstract by forgetting about what the things are, and retain information about how they behave, and about what abstract properties they satisfy. The insight is that 2d locations and 2d displacements have the same abstract properties, which are modeled by a certain algebraic object: 2-vectors.

earthicus··on Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
> This course [Strang] is apparently the holy grail course for Intro Linear Algebra.

I haven't watched his lectures, but I TA'd a linear algebra course that used his text book, and strongly disliked his presentation. I've heard that's a fairly common reaction actually - it's one of those love it or hate it books. I'm bringing it up because if you (or someone else reading this) turn out to be in the group that doesn't love it, you should not give up on loving linear algebra! You are definitely still allowed to have a different 'holy grail course'!

earthicus··on Quantum theory cannot consistently describe the use of itself
This issue is addressed informally in the introduction to the authors paper available here [1]. The pivotal move that addresses your complaint head on is Theorem 4.3.

[1] https://www.jstor.org/stable/2695030

earthicus··on Quantum theory cannot consistently describe the use of itself
It's more subtle than that, for example:

https://en.wikipedia.org/wiki/Self-verifying_theories

← PreviousPage 4 of 5Next →