2,663 karma · joined July 11, 2023
Some things you may have heard me say:
-- "If you find you're shooting yourself in the foot, do not reload."
-- "Videodrome was a documentary."
-- "Instead of saying 'no', ask how the world would have to change so your answer could be 'yes'."
-- "Belief flows towards that which can be monetized."
-- "Money is theft. The economy is a lie."
-- "Reflexive modernity has made Ballard's 'High-Rise' A love story."
Nortel, RSA, Borland, Linden and SiFive. I keep working for companies that don't know how to do an exit.
I don't do X, Facebook or LinkedIn. The closest thing I have to social media is [[ https://www.youtube.com/@OhMeadhbh ]] where I've uploaded a few retro-computing related videos.
Strangely, this is the video I'm most proud of: [[ https://youtu.be/J-tdfUXi9PI ]]
.
I honestly have no feelings one way or another about this.
The article could have used an abstract, you have to read
a third into it before the text starts relating to the
title.
But... It does a decent job of pointing out diagnoses in
various DSMs describe sets of symptoms and not etiologies.
Which is to say, a "disorder" in the DSM doesn't give a
biochemical explanation for the origin of a behaviour, it
just describes the behaviours (often using self-reported
observations of one's own emotions.)
Given the way English-speaking humans use language, I
would argue that "superpower" is something more akin to an
innate ability. It's not //just// a description of
behaviours. Superman is superman not simply because he
leaps tall buildings with a single bound or because he
races faster than a speeding bullet. The state of being
called "Superman" is dependent on Kal-El / Clark Kent's
path through phenomenal existence. (I'm obviously using
Superman as the exemplar of entities who possess
super-powers.)
If the nature of having a super-power is innate to the
individual and the underlying hypostasis of an ADHD
diagnosis is dependent on descriptions of behaviour
independent of any biochemical cause then yes,
"superpower" and "ADHD" are not in the same class.
However... Gods of Catachresis forgive me... Language is
complex and those damn'd humans often use it imprecisely.
From context, I think we can infer that "ADHD is a
Super-Power" means that the behaviours described by ADHD
in the DSM-X are associated with iteologies which confer
benefits to the individual.
Still. I enjoyed reading the article. When I first saw the headline, I thought Apple had
launched an AI that converts ASL to text. While that
would be great, that's not what this is. In fact, the
article mentions "the company is not using any
AI-generated interpreters." I suspect this is to keep in
the good graces with the human sign language interpreters
they have working at signtime.apple.com.
Still... happy to see Apple taking #a11y seriously again.And CPU power consumption is only part of the whole system. And a lot of the system power scales with bus speed rather than inverse CPU age. It's possible recent systems will consume more electrons than older systems.
Modern top-of-the-line RasPis seem more like ARM PCs with fast, efficient multi-core CPUs and GigE. I bought a RasPi 500 at the beginning of the year just to see what it was like and it's my new "email and light web browsing" daily-driver. Though yeah, I probably wouldn't have paid $410 for it.
I bought my original RasPi mostly for the I/O. I wanted to blink some lights, drive some servos. And if I wanted to do that again, I would probably buy a Pico or Zero.
One of my pet peeves is when people, trying to make a
point, use code that doesn't compile. I mean, it's fine
when you're sketching out code on a white board. But on
an article you've had time to prepare, it's a little
annoying.
Take for instance, this code fragment:
.. static void *ptrs[1000];
..
.. int main(void) {
.. for (int i = 0; i < 1000; i++)
.. ptrs[i] = malloc(16);
.. }
.. }
I'm pretty sure what they //meant// to write was:
.. #include <stdlib.h>
..
.. static void *ptrs[1000];
..
.. int main(void) {
.. for (int i = 0; i < 1000; i++)
.. ptrs[i] = malloc(16);
.. }
.. return( 0 );
.. }
I understand why the author produced the code on top
instead of the code at the bottom. The code on the bottom
includes features extraneous to the conversation. The
include directive and return statement only serve to
distract from the point the author is making.
If you read far enough down, you'll see he has links to a
broken GitHub repo presumably with code fragments. (or
maybe GitHub itself is broken today or it decided it
didn't like me trying to access the repo from an AT&T
fiber line.)
I'm sure when GitHub decides to behave and serve bits like
it's supposed to, there will be compilable code so readers
can understand the author's intent within the context it
was intended to be viewed.
Which is to say:
1. It's probably okay to have only code fragments in the
main part of your discussion. Please provide a note
that there is code which shows your snippet in the
context of a compilable program. And put that note
somewhere near the code fragment.
Or... consider putting a note at the beginning of the
article saying something like "Compilable versions of
code fragments in this article are available at a
GitHub repository referenced at the bottom of the
page."
2. Do not depend on GitHub to hold your code fragments.
You do not know when it will be down or which readers
it will randomly decide to block.
3. I really do think you should include more of the
"layout" code. When reading "The Address Space"
section, it was unclear where the initialized,
uninitialized and local came from. I initially thought
the author was using a version of C I had not yet
encountered that defined these symbols.
4. Since the code uses ``sbrk()``, the author should
probably have cautioned readers the code isn't POSIX
compliant, but should compile and run on Linux systems
using gcc. There's a comment about demonstrating it
with glibc, but I think that's not a strong enough
warning since you can compile programs with clang that
are intended to link against glibc.
I doubt there are many QNX users out there who expect
random code from the internet to run on their systems
without alteration, but it seems good form to describe
the environment you are targeting.
Now I'm wondering if this is expected to work on Darwin
as well as Linux.
5. It might be a decent idea to order the SHOW()
statements in the code in "The Address Space" section
to follow the order of the diagram at the bottom of
that section:
.. SHOW( "local (stack)", &local );
.. SHOW( "printf (libc)", printf );
.. SHOW( "program break", sbrk(0) );
.. SHOW( "malloc(16) (heap)", malloc(16) );
.. SHOW( "uninitialised (bss)", &uninitialised);
.. SHOW( "initialised (data)", &initialised );
.. SHOW( "main(text)", main );
6. In the "Chunks and Headers" section, it may be
interesting to mention what the flags in the allocation
headers actually mean.
7. glibc does late fill, right? I can't remember. If it
does, it might be useful to mention in the Demand
Paging section since it affects the program logic.
Now that I've yelled at the cloud a bit, allow me to say,
I enjoyed the article. Things I liked:
1. The author used the exact strace command they used to
produce the output discussed in the text of the
article.
2. The graphics are quite nice.
3. Despite grousing about fragments being fragments, they
do a good job of illustrating points made in the text.
EDIT: After complaining about GitHub not being available,
it's finally come back. The web interface is still borked
for me, but I can clone the repo mentioned at the bottom
of the page and view the local copy of the source.I do text browsers because I live my life in a terminal and it's easier than double-clicking on another part of the screen and waiting for the graphical browser to launch. I also only have 16Gb of RAM, so I can only have a few browser windows open at a time.
And yeah... using a mapping site on a text only browser would suck.
It needs a sentence or two at the top of the page explaining what the app does and why I should be interested.
I'm viewing the content on a desktop web browser, not an iPhone. Maybe Safari renders this differently. In that case you should have text at the top saying "you need to have an iPhone to view this content."
What are you going to do with your new-found CS knowledge?
Are you going to make the next google? Are you going to
get a job at the local insurance company processing
claims? Teaching yourself without a degree is a bad path
if you want to do grad school.
Maybe you want to understand how software works so you can
have a better understanding of the world and participate
more fully in society? Well... I can't argue with that.
I'm bearish on using AI to teach yourself CS because AI
doesn't teach people CS. If you learn something about CS
because you're looking at the output of an AI model, it's
sort of a side-effect.
We probably have a very different idea about what "CS" is.
I think of it as an organized exploration of notation,
processes and proofs related to a branch of applied
mathematics whose subject is general purpose computing
devices. Asking an AI "give me a function to calculate
the fibonacci sequence in rust" isn't going to help you
understand a) where the fibonacci sequence came from, b)
what recursion is (and why and how it was introduced) and
c) how the lexemes in a programming language map to an
abstract process which when reified delivers the fibonnaci
sequence.
I've picked a pretty simple example as a straw-man, mostly
because I think it //should// be knocked down. If this is
what you're doing to "learn CS" then more power to you,
but you're probably not doing yourself any favours.
You probably can use AI with prompts like "generate
example code that implements the abstract factory pattern
and explain how each function relates to the pattern" and
get a fairly decent explanation. Modern agents can keep
enough of a context you can ask it some decent questions
if its examples aren't entirely clear.
I've used and seen other people use Claude Code to
interatively generate design work. Mostly APIs. It's
hardly ever right the first time and Claude Code sometimes
barfs if you ask it to explain why it did a particular
thing. But it's mostly decent and in a few cases it has
pointed out a few ragged edges I didn't notice.
But... I learned how to map between human requirements and
software on my own. I don't know if someone could learn
expert level design by examining the output of a tool that
was trained on mediocre code.
And Claude Code really doesn't understand how to interpret
my prompts about TLA+ and Coq/Roq. It doesn't generate
complete BS. I'm thinking there's just not enough
training data included.
In the old days, if you went to a decent school like
Harvard or Yale or CMU, you could be reasonably assured
the education wouldn't be bad. [[1]] You could go to a
cheaper state state school and get a decent education,
though there was always the chance you would get a crap
instructor or two.
There's an idea that you can teach most people to be
effective software developers by putting them in front of
a terminal with a man page and a c compiler. I believe
this is bullshit. This technique will work for //some//
people, but not as many as sitting you in a class-room and
having an expert explain what the important bits are and
stepping you through the reasoning of why.
I think "learning by AI" may work for //some// people, if
they figure out how to ask the right questions. I
recommend reading decent books like Gries' "The Science of
Programming" or Knuth's "Literate Programming." (You also
have to read SICP because it defines a base level
understanding that all those CS grads have supposedly
learned.)
But I'm reminded of the end of the movie Hidden Dragon,
Crouching Tiger (spoilers ahead) where it is revealed the
antagonist learned kung fu from a well regarded book, but
since they couldn't read, they only looked at the
pictures. They understood the forms but not the
motivations for why the forms were developed. The
antagonist was a formatable foe, but was eventually
defeated because that minor difference in context was
sufficient to lead to their defeat.
I don't think you can learn to be an expert computer
scientist exclusively by reading books / papers. But you
can come close. I don't think you can learn to be an
expert computer scientist exclusively by asking AI to give
you example code, explaining it and critiquing your code.
Mostly because "being an expert computer scientist" is
less about being a 10x coder and more about understanding
the relations between abstract concepts, notation and
symbolic manipulation, how concrete problems are
represented and manipulated and how this all relates to
concretization using computing machinery.
AI gives you an answer, not the understanding embedded in
the text from which the answer was derived.
But if you do it right and you ask AI the right questions,
that understanding can be revealed.
I think my sense is that it is very easy to use AI wrong
and difficult(ish) to use AI as a learning tool. I
sincerely wish you well and would love to read a blog
about your experience.
1. Do not ask about MIT. They're beyond salvaging. File under "old man yells at clouds."
I think it's worth asking what a CS degree is for. Is it
to teach you how to code and make you obviously hire-able
by industry? Maybe it's to teach you how to think about
data and code? If you think it's the former, then AI is
probably going to be a problem for you. If the latter,
it's neutral to somewhat good.
I've been hiring CS grads for 4 decades (yikes!) and
there's definitely been a shift. Not all existing
programs are bad. Not all young software devs are bad.
But... the percentage of recent grads that seem to
understand what data processing systems are about has
definitely fallen.
Us old farts in industry must share some of the blame
here. Our industry seems to be pretty boom or bust.
Someone comes in with a stack of money and tells people to
build { the web | blockchain | AI | virtual worlds | etc }
and suddenly there's a rush. At the start of the gold
rush, we're not sure how to build everything that's going
to be the next google [[1]] so we fill the room with young
kids who have seen some recent tooling and will work
cheap. We don't develop them. We want them to be
compliant drones dancing to a tune played by a CTO and
VP/Eng who got their jobs because they're the children of
the fund investors who gave the startup a bunch of money.
And then we go back to Universities and tell them "OMG!
Your not bar-raising your grads by teaching them __fill in
the blank__!" [[2]]
So... I don't doubt it looks like AI is destroying the
degree. But maybe it's just making it hard to ignore
previous problems with the uni to industry pipeline.
And I didn't mention the Mythical Man Month once in this
comment. I'm getting better.
1. I'm not sure too many people want to be Google at the
moment, but over the last 25 years, they've certainly
done well.
2. I'm intentionally misspelling "you're" because in my
time in industry, I've found only about 15% of people
would pass a 7th grade spelling test.