HNHacker News
TopNewBestAskShowJobs

thelaxiankey

50 karma · joined August 15, 2024

submissionscomments
thelaxiankey··on Exit the Cave
Call me crazy but I don't think wanting to successfully achieve real things in the external world is bad
thelaxiankey··on Exit the Cave
Learning a language in this way is some sad boi stuff
thelaxiankey··on Exit the Cave
I've gone from amateur punter to moderately competent athlete (think d3 college team, though my sport has no such metric), and my thought is this: The only way to get better if you've plateaued is to change something. The external reasons you fail matter only because they tell you what to change internally. I've done things that surely not more than 100 people have done, and I'm not, by any metric, in the top .000001% or whatever. I just decided to do them and fought hard, it really was that simple.

This also relates to my interp of the article. There's grinding/training and then there's "having that dog in ya". He's trying to remind people to do the latter.

thelaxiankey··on The turbulent AI era is here
where is the error? 9 years ago (2017) 'attention is all you need' hasn't been written yet, no llms exist. his take is literally 'it would be cool if something like llms existed', seems fine (if anything, vaguely predictive) to me.

As for Kokotajlo, he's a good SF author, but I don't think it's nearly as good a prediction as it appears at first glance.

Like any SF, he's correct about some things, and way, way off base about others. Specifically, he was mostly correct about short-term (1-2 year horizon) technical aspects, but anyone familiar with how transformers work would have guessed those. I'm not even in AI/rationalia land, but believe I was having these exact conversations by 2021. Specifically about multimodality and steam-of-consciousness ['chain of thought' reasoning]. He is spot-on about chip shortages (to my eyes, his most well-done prediction).

Other thoughts are a storytelling device, like a well-told horoscope. He makes non-categorical statements that were already happening as if they categorically will become a new thing. But really he's just going off the current trend that everyone knows, and thus will be nearly-impossible to falsify. For example, 'People who still remember 2021 think of it as the golden days, when conformism and censorship and polarization were noticeably less than they are now. Just as it is normal for newspapers to have a bias/slant, it is normal for internet spaces of all kinds—forums, social networks, streams, podcasts, news aggregators, email clients—to have some degree of censorship (some set of ideas that are prohibited or at least down-weighted in the recommendation algorithms) and some degree of propaganda.' Sounds scary! But it is literally just saying 'polarization and marketing specialization will continue to deteriorate'.... which, duh. In essence, you could make this statement for 2018-> 2021, or for 2008->2018 and 'feel' just as correct!

Other key thoughts were somewhat off. Specifically, 'It now costs an order of magnitude less compute (compared to 2020) to pre-train a giant model' is kind-of-true, in that it costs less now, but the models have gotten so much bigger that the prices haven't actually gone down much. Might be changing soon, but definitely several years off.

The scariest central prediction that the political stuff rests on is 'After years of tinkering and incremental progress, AIs can now play Diplomacy as well as human experts'. This part, as far as I can tell, is just not true and hasn't changed.

And, well, 2026 predictions are just not correct at all. Some examples: 'Mormons create a “Christian Coalition” internet stack, complete with its own email client, social network, payment processor, news aggregator, etc.' -- basically untrue. I know a few ex-mormons, such a thing is not prolific.

'The US and many other Western governments are gears-locked' The US is far from gears-locked, in fact, it's full-steam ahead to er, well, something.

'“Should I wear shorts today?” “Order some more toothpaste, please. Oh, and also an air purifier.” “Is this cover letter professional-sounding?”' -- kind of correct, but in practice most people just do the last one. I'm not aware of many that give chatgpt agents credit card access (refer to the famous vending machine experiment). But predicting this with GPT3 is not that crazy, cause people were already doing that.

Personally, I am much more biased towards the METR timelines/way of thinking: https://www.lesswrong.com/posts/deesrjitvXM4xYGZd/metr-measu...

I found Kokotajilo's response comment to this kind of, idk, immature, and not especially mathematical.

thelaxiankey··on Octopus intelligence may be related to never-before-seen mutation
maybe he/she missed the part where they reconstituted the break in e coli to show that it had the molecular effect they said it did?
thelaxiankey··on Octopus intelligence may be related to never-before-seen mutation
not sure I agree, they reconstituted this mutation in E coli ribosomes, using Fluc as a luminescence readout, and saw a reduction in aggregates at similar luminescence without a reduction in translation speeds.

Not really familiar with translation machinery or luciferase, but it seems pretty compelling to me.

thelaxiankey··on Linear algebra done right
The thing about linear algebra is that it isn't really a cohesive subject in the same way that calc is. This is why you get as many perspectives as you get commenters.

There are some central concepts, and which ones matter to you depends on what you're planning to do with your future. The key points are:

* Matrices/vectors as grids of numbers/computational tools.

* Matrices/vectors as positions and transformations of those positions.

* Matrices/vectors as more abstract geometric objects

* Matrices/vectors as algebraic objects.

There is no 'done right' imo. My sense is LADW is probably the best option for a motivated honors math student, because unlike Axler the author doesn't hate determinants for whatever reason. Strang would work well for engineers. Axler is mostly concerned with the last two, but IMO this makes him kinda niche.

thelaxiankey··on Writing by hand is good for your brain
Maybe I'm cynical, but I always get excited, only to be really disappointed by the other person's thoughts :/ They never feel like they're contributing much.
thelaxiankey··on A Beautiful Theory Falls to Ugly Data
Anyone more econ literate know why Coase isn't trivially answered by accounting for corporate time-discounting? Maybe I'm missing something, but this always confused me.
thelaxiankey··on What to learn to be a graphics programmer
If you could beat Godot and Unity in two weeks with AI, why doesn't everyone just do this?

(A: there be dragons)

thelaxiankey··on The deadly rise of giant trucks and SUVs
[flagged]
thelaxiankey··on A cell so minimal that it challenges definitions of life
def not life. there is no sense in which a virus... 'does' anything, it's not agentic. it's kind of like a free-floating loaded spring.
thelaxiankey··on Vodafone Germany is changing the open internet, one peering connection at a time
i've wondered for a long time why this isn't a more common solution to these services that are almost inevitably monopolous. power, water, and internet kind of things.
thelaxiankey··on ADHD drug treatment and risk of negative events and outcomes
the thing about being human is you internalize cultural values as your own.

if you lived in a society that valued, i dunno, tracking and hunting down giraffes in small groups, would you have the same struggles? what if just participating in society required ~20 hours of athletic activity a week? i'm not entirely convinced you would have this problem, based on the anthropology i've read.

the signal of a maladaptive culture is not 'i feel like the people around me have a moral failing'. It is 'i, and many others, feel like we've all got basically the same moral failing.'

personally, this has been a very helpful reframing. If I simply can't bring myself to do something, that means not that I am bad and my willpower is bad, it just means that something is materially wrong and I should consider addressing it by doing things that my body will let me do.

thelaxiankey··on New study of birds shows citizen science can be trusted
i'm well aware of how medications are developed. i'm talking about biology, not medicine. there is a world of difference. pharma companies combine tech that gets developed in academic labs in clever ways to treat diseases. but make no mistake, most of these techniques come out of academia.

if you think CRISPR or P1 transduction were discovered outside academia, you are wrong. and this isn't even discussing stuff with no immediate clinical applications that is nonetheless important (jumbo phages, asgard archaea are hot rn)

thelaxiankey··on Exercise before bed is linked with disrupted sleep
I used to be like this back when I chronically under-exercised, it was the only thing that would help me sleep. And even then, I struggled with insomnia.

Personally I need 10-20 hours of real sport a week to function really well, which seems to put me in some very high percentiles on HN. I need so much sport that I barely have time to do anything besides work and exercise, which means I don't do many non-athletic hobbies anymore.

thelaxiankey··on New study of birds shows citizen science can be trusted
I mean, for like, some ML research, sure. For certain, even most, aspects of electrical engineering, absolutely. But for biology? Absolutely not.

And even in more computer-adjacent fields, this is still ridiculously reductive. Geoff Hinton is an academic through-and-through, and he changed the world even for computer scientists. What about someone like Don Knuth? I mean, even google's pagerank started as an academic project.

Engineering firms do great research too, but this is not the only way.

thelaxiankey··on New study of birds shows citizen science can be trusted
uh... maybe in your field. personally i've never seen good physics on Vixra or good biology anywhere except in biorxiv or journals.
thelaxiankey··on What if we made advertising illegal?
i'd say the success of substack flies directly in the face of your claim
thelaxiankey··on Electron band structure in germanium, my ass (2001)
This is crazy to me because when I've run labs in the past, there were equipment failures literally all of the time. When you teach lots of people, shit breaks. Quite often if something didn't work, I'd just have one student swap equipment with another student to help diagnose this sort of thing.

Major bummer that others have had differing experiences from me, here.

thelaxiankey··on Electron band structure in germanium, my ass (2001)
'flunked everyone who claimed they got the supposed "correct" answer to three significant digits because that was impossible.' while I've never seen anyone flunked for this, I certainly have taken off substantial amounts of points, and seen others do the same, for 3 significant figures when 2 is the absolute highest reasonably possible (and realistically, one sig fig was what we actually wanted).

I've run the exact lab you're describing, and I think we gave full credit for anything between 5m/s^2 and 20 m/s^2 provided there was some acknowledgement that this was at odds with what was expected. We very often would check in halfway through class and either tell the kids what they were doing wrong, or even tell them to write something 'this is at odds with literally all known science and I think I don't trust this'. For this particular lab, I've never seen errors as large as the ones you've described, so your lab was likely very poorly set up.

In other cases, I've made extra time (and allow students to come in) in case their numbers were so weird as to be problematic; just depends on the lab. Any teacher worth their salt will do this. It's a shame the teachers you had were terrible and incentivized bad stuff.

If being in a lab has taught me anything, it's that doing good science is often morally difficult. Sticking by your guns is hard.

But you are right in some sense: there are definitely incentives to... misreport. The best we can do as teachers is to reduce those as much as possible and reward kids/students for being honest.

thelaxiankey··on One Last Ride for Antarctica's 'Ivan the Terra Bus'
not sure about anyone else, but the scientists I know who worked there only stayed for a few seasons, which makes this pretty damning.
thelaxiankey··on All Placebos are not created equal (2021)
Oh huh. Just quickly glancing, it seems that indeed you may be right, at least for a lot of the standard things it's used to treat. The exception seems to be allergies?

I'm not sure that invalidates my broader point in any case, but good to know!

thelaxiankey··on All Placebos are not created equal (2021)
I think my favorite point to this effect is that there's plenty of medical literature (in the Lancet, and others) suggesting hypnosis is as effective as certain drugs for killing pain in certain contexts. And hypnosis is nothing more than talking someone, in a very directed way. There's caveats of course, but that's true of all drugs... Not to mention all this stuff on gut microbiota, and even the truly 'woo-woo' stuff like acupuncture. Personally, I don't think it's crazy at all to imagine that sticking a needle near the right neuron can cause some kind of occasionally helpful physiological response... in fact, it would be almost more surprising to me if this wasn't possible. Modern medicine works wonders for infectious diseases & physical issues, but I'm not entirely convinced we have a handle on the more subtle stuff.

I've been a lot more attentive to this kind of stuff lately due to some chronic health stuff that came up in the family. I think there's probably some framework in modern medicine that makes it less prone to adopting these kinds of methods. Maybe it's just historical baggage, who knows...

thelaxiankey··on Docs – Open source alternative to Notion or Outline
Typically a FOSS community seems to take a while to get started, but once it gets going (Blender, Linux, etc) it tends to stick around and even seriously gain traction.
thelaxiankey··on The Graphics Codex
it looks alright -- 10 bucks is not much for a book. but there are already many great graphics books out there, and resources like inigo quilez's blog are absolutely incredible for the burgeoning graphics programmer
thelaxiankey··on Everything You Ever Wanted to Know about E. Coli (2008)
Also happen to be in microbiology, but pretty far from the medical side of things.

Do you have a citation on the fact that 'most' pathogenic strains have a plasmid making them so? Some guys in our lab have been playing around with plasmid copy number lately (in a largely 'basic science' kind of way) -- this could give some nice context for that work.

← PreviousPage 2 of 2