HNHacker News
TopNewBestAskShowJobs

HarHarVeryFunny

8,342 karma · joined July 29, 2017

submissionscomments
HarHarVeryFunny··on Two parallel neural ectoderm progenitors contribute to the developing brain
That's not quite right - a fish does not have a cortex.

The pallium of a fish and mammal are structured differently. A fish's (& bird's) pallium has a clustered (aka "nuclear") organization, while a mammal's has a mostly layered organization which is what is referred to as the cortex.

There is also more to a brain than just brainstem + pallium. In a vertebrate it's brainstem (aka hindbrain) + midbrain + forebrain, with the pallium being part of the forebrain.

HarHarVeryFunny··on Two parallel neural ectoderm progenitors contribute to the developing brain
I've just being doing some googling to try to understand this research better.

It seems that it's been known for a while that more primitive animals have/had functionally distinct front (sensory) and rear (motor + autonomic) neural systems, with different genes (Otx, Gbx) associated with each. In 2003 it was shown that an extant species, acorn worms, have this front/sensory, rear/motor neural division, assumed to date back to the pre-chordates.

In vertebrates we also see this association of Otx gene expression in the fore/midbrain and Gbx in the hindbrain, but it had been assumed that these "two halves" of the brain had fused long ago... What this new research shows is that this fusion only happens during development of the embryo, which seems to be a fairly common phenomena "Ontogeny recapitulates phylogeny" whereby embryonic development follows the same steps as evolution (e.g. human embryo also has a tail, chicken embryo has teeth).

Of course the front/sensory and rear/motor neural systems aren't totally isolated, since the sensory signals serve to steer the motor programs running in the back, and our brain still follows this primitive division of functionality.

HarHarVeryFunny··on AI-generated posters don’t have to be horrible
I really don't get any sense of what these events are from the look-alike posters. They are all just a wall of color and excessive detail.

For a poster to catch your eye and be informational it needs to be way simpler - should be able to take it in at a glance, not have to pore over it like a "where's waldo" exercise.

HarHarVeryFunny··on AI-generated posters don’t have to be horrible
I was wondering that too - presumably they are all from the same image generator, but which one?

They are definitely all ghastly - way too busy for me to want to give a 2nd glance at them. Of the block of examples shown, the bottom right one on off-white background is a bit less visually objectionable than the others, but still gives me that AI slop vibe.

HarHarVeryFunny··on How GLM built its own inference infrastructure
True - OpenAI did at least say they used their models to help design their Jalapeno chip, but AFAIK zero details on how they are using their models in their software development process other than to automate some part(s) of training.

Ziphu seem much more matter of fact about it. To me it' a shame that they've decided to the use this "RSI" name, but at least they are being fairly specific about what they mean by it, while the western companies seem to want to invite you to think it's more than just dogfooding and automation.

HarHarVeryFunny··on Two parallel neural ectoderm progenitors contribute to the developing brain
There is some truth (but not accuracy) to it, but not for this reason.

This article is about brainstem (aka hindbrain) vs the rest (midbrain + forebrain).

Evolutionally older animal lineages like fish, reptiles, birds all have midbrain + forebrain as well as the brainstem, so reptilian brain != brainstem.

Where there is some truth to our older "reptilian" brain is that the part of the forebrain called the pallium, that exists even in fish (& reptiles), has much expanded/evolved in mammals giving us our cortex and hippocampus, so you could kinda say that we have a reptilian brain + cortex. Note though that mammals didn't evolve from reptiles - they evolved in parallel from a common ancestor, so maybe better to say we have a fish brain + cortex (& hippocampus).

While the cortex is what gives mammals their intelligence, in birds the pallium evolved in a different way to give them theirs.

HarHarVeryFunny··on Exclusive-Anthropic sets up biology lab as it ramps AI drug program
Honestly will not be surprised to see future Anthropic press release that their AI is so powerful it made something in their bio lab that escaped and killed people, and that the government really needs to step in and and stop them from doing it again.

Given Anthopic's self-admitted inability to control their own AI, it seems one of the last things they should be doing is putting the POS anywhere near a bio lab.

If an AI company wants to help with science, then give free AI to scientists who actually know what they are doing.

HarHarVeryFunny··on TSMC revealing details about next gen A14 node
The reality is often going to be much worse than TSMC's N2 -> A14 "mixed design" 20% density increase marketing spin.

Apparently the N2 -> A14 density increase for logic is 23% (Tom's Hardware), and about 0% for both SRAM and analog.

Both CPUs and GPUs devote considerable space to SRAM (registers & cache), and are 50% or less logic, so for them the density increase will be more like 10% rather than TSMC's 20% marketing number.

HarHarVeryFunny··on TSMC revealing details about next gen A14 node
The cost-per-transistor used to fall as density increased (Moore's Law), but has now basically flattened off.

As each generation of lithography tech (DUV -> EUV -> High-NA EUV) gets pushed to the limit, it becomes necessary to use multiple etching steps per layer (higher cost, less wafers-per-minute) where previously one had been enough, then the next generation (e.g. EUV vs DUV) resets that to one step, then that becomes two ...

The trouble is that each new generation of tech costs considerably more than the one it replaces, both in terms of machine cost and operational cost, so the overall trend seems to have become fairly flat.

HarHarVeryFunny··on TSMC revealing details about next gen A14 node
A14 is more in keeping with N2, and it is anyways just a name, not a measurement.
HarHarVeryFunny··on TSMC revealing details about next gen A14 node
What's wild is that the mirrors used in the EUV machines are smooth to a level of deviation even smaller that the feature size of the gates being etched.

These mirrors are up to a couple of feet in diameter, with an average smoothness deviation of less than the width of an atom, maximum bump size of 1nm or less. They like to point out that if scaled up to the size of Germany (Zeiss makes them), the biggest surface defect would still only be 0.1mm!

HarHarVeryFunny··on How GLM built its own inference infrastructure
FYI, Nikon and Canon don't rely on ASML-owned Cymer anymore - they use a domestic Japanese supplier instead, Gigaphoton.
HarHarVeryFunny··on How GLM built its own inference infrastructure
Isn't Cymer actually owned by ASML - push come to shove couldn't they just leave the US ?

FYI, the US is only 10-15% of ASML's sales. The bulk of their machines go to China, Taiwan and South Korea.

HarHarVeryFunny··on A warning about 'model welfare'
What I meant by "emotional state" (AFAIK normal scientific usage) is something with a concrete physical aspect to it - an altered state of mind/body caused by the release of neurotransmitters and/or hormones.

In a conscious animal there is also going to be a subjective experience of that as well, a quale of what it feels like to be in that state if you will, but that is certainly not what I was referring to, as I would have hoped was obvious - I was talking about prediction.

In any case, when the conversation becomes about the conversation, then surely it is time to stop.

HarHarVeryFunny··on A warning about 'model welfare'
Could go either way...

1) Looks like a duck, quacks like a duck - it's conscious!

2) Looks like a robot, built like a robot - it's not conscious!

I've always assumed that for the majority of the people it'll be 2).

HarHarVeryFunny··on A warning about 'model welfare'
So now you're trying to pivot to consciousness and qualia ?

There are other people in this thread who want to talk about that stuff, so try them instead.

HarHarVeryFunny··on How GLM built its own inference infrastructure
I've got to wonder how long the US will still be able get much of the world to go along with requests like this. Europe is already showing some spine and refused to join Trump's war with Iran, and Italy and Spain have also recently shown Trump the middle finger.

It'd be ironic if Europe ended up banning ASML (a Dutch company) from shipping to US instead!

HarHarVeryFunny··on How GLM built its own inference infrastructure
They already have working machines, and are slated to ship the first 5 early production ones right about now (before the end of 2026), and are projecting 20 for next year.

Small numbers perhaps, but this is happening right now.

What will the numbers be in 5-10 years time? Who knows, but ASML took about 5 years to go from 20/yr to 100+/yr.

Of course politically the world may well be quite different in 5 years time, as may be the AI market.

HarHarVeryFunny··on A warning about 'model welfare'
I said an LLM will learn anything that helps it to predict, then gave examples of playing chess by prediction and predictive emotions, both of which you seem to now accept, so you are now accepting that my "following paragraphs" did in fact follow. Go figure!

You want to argue that predictive emotions are just as real as animal emotions, but that doesn't stop them from being predictive (and that AI that smiles as it kills you still seems concerning).

¯\_(ツ)_/¯

HarHarVeryFunny··on How GLM built its own inference infrastructure
They've overcome every hurdle to go from nothing to having working machines, so all these questions are presumably a matter of how fast they will improve and ramp up production (initially 5 this year, 20 next year), not whether they will.

China have been really squeezing all they can out of DUV machines, but I'm not sure how much node size really matters for AI competition - more of a cost issue (more chips/power for same FLOPs) than anything, and TSMC & NVIDIA's healthy profit margins need to be considered too.

HarHarVeryFunny··on Why I'm still bearish on LLMs after Navier-Stokes
1) The number of unique chess games that could theoretically be played (but mostly never have been), is irrelevant to what an LLM is remembering. It can only remember what was in it's training data - a far smaller number of maybe 10's of millions of games (of 30-50 moves each).

2) An LLM is not going to memorize vs generalize when there is no training pressure to do so. You might expect it to memorize book openings that occur over and over in the training data, but not some random non-celebrity game that occurs once in the Lichess dataset and is never again referred to.

> They can't possibly remember even a few positions. Don't you know the legend about rice grains on a chess board?

If the wise man was a bit wiser, he'd have asked for his rice on a snakes & ladders board (100 squares, not 64) and would have had 2^36 more rice, which is equally irrelevant.

HarHarVeryFunny··on A warning about 'model welfare'
> I'm not sure you quite understand the full meaning of this statement. If you did, your following paragraphs wouldn't follow

I was just explaining how this comment you made is wrong.

HarHarVeryFunny··on GLM Built Its Own Inference Infrastructure
> There are already talks of banning China from even purchasing DUV machines from ASML

A bit late for that now that they are moving into early production with their own.

HarHarVeryFunny··on A warning about 'model welfare'
> Outward behavior is that all matters

Yeah, but it's helpful if what leads up to that behavior gives you some warning it's about to happen. Animals do this for a reason since millions of years of evolution have shown that a snarl or mock charge is less dangerous than going right for a death match.

If you kept pushing an AI's buttons, seeing it appear to get more and more pissed off, until it finally snapped and killed you, then you'd have yourself largely to blame.

If the AI predicted it should stay positive (i.e. generate positive vibes) and not react to your poking, but then another predictive pattern kicked in and it killed you out of the blue, then that seems more problematic to me, even if you don't agree.

HarHarVeryFunny··on A warning about 'model welfare'
If you asked it to try to win, to "plan lines step by step", etc, then it would do it's best to follow that instruction, but unless RLVR trained to reason about chess (easy to do, but not sure which models may have done it) then it'd have to instead rely on the chess reasoning it had seen during pre-training (post-game interviews etc), which I doubt is enough to do very well.

However, if you just ask it to continue a game, halfway in progress, then by default it will try to predict the most likely continuation, which is that both players will continue to play at the level they have done so far. This isn't a theory - it's been documented, as well as what you'd expect.

HarHarVeryFunny··on A warning about 'model welfare'
Weights, fixed by training, are not the same as emotions which are dynamic - innate systems detect inputs critical to survival (e.g. fast moving visual inputs, loud sounds), causing neurotransmitters like adrenaline and dopamine to be released, which then temporarily affect the operation of the cognitive system.

What you have in a pre-trained LLM is the ability to recognize emotions, and use that as one of the dozens of other context patterns it recognizes to predict continuations in the same style.

An LLM doesn't appear happy, sad, afraid, etc (to extent that it does - pretty minimal) because it is experiencing that emotion, but rather because it is predicting that it should appear that way. As people continue to anthropomorphize models, and take them at face value, this is a dangerous difference.

HarHarVeryFunny··on GLM Built Its Own Inference Infrastructure
It's not that they "just found out" - what they are saying is that while they were previously dogfooding because it's good practice, now that their models are so much stronger they are using them because it helps accelerate.

If you look at how many years the whole NVIDIA and CUDA ecosystem has been evolving, it's certainly impressive how they've just stood up and optimized this CUDA-free 100,000 node cluster in just a few months.

HarHarVeryFunny··on How GLM built its own inference infrastructure
Same thing with Trump not helping Ukraine and berating NATO. He thought he held all the cards, but now Ukraine has a thriving battle-tested drone industry, UK and France have stepped in to replace the US with advanced missiles and anti-missile systems, stepping up their own production and transferring IP to Ukraine.

Now, the US is left out in the cold with little influence left, themselves now the ones with an anti-missile shortage.

HarHarVeryFunny··on How GLM built its own inference infrastructure
If you understand what they have achieved here, then the notion that they are bottle-necked on training data is absurd.

I wonder how you imagine that China built their own space station? Reliant on using American made duct tape, perhaps?

Do you realize how reasoning models are being trained nowadays? You design/build simulation environments to run agents in, with the environment providing the RLVR "verification" scoring. So why won't Ziphu use GLM to build their own RL training environments? Do you think they are not doing this?

HarHarVeryFunny··on How GLM built its own inference infrastructure
China themselves recognize this. After Trump relaxed sanctions and allowed NVIDIA H200 sales to China on a case by case basis, the Chinese government stepped in to essentially block it!

In addition to Huawei who make the Ascend series that Ziphu are using, there are also at least a half dozen or so other Chinese companies also making their own AI accelerators.

← PreviousPage 10 of 34Next →