HNHacker News
TopNewBestAskShowJobs

HarHarVeryFunny

8,344 karma · joined July 29, 2017

submissionscomments
HarHarVeryFunny··on GLM Built Its Own Inference Infrastructure
Wouldn't it be refreshing if OpenAI and Anthropic were this open, and spelled out how they were using their own models during development and rollout?!

All I can recall reading from OpenAI about what they have actually done in the name of "RSI" is using one of their models to help automate the training process.

HarHarVeryFunny··on How GLM built its own inference infrastructure
Ziphu, aka Z.ai, is the company that makes GLM (a very competitive Chinese LLM).

Why would you be reading their corporate blog posts if you don't even know who they are?!

HarHarVeryFunny··on How GLM built its own inference infrastructure
Ziphu (who make GLM) use Huawei Ascend processors made by SMIC. Huawei use a combination of domestic memory from CXMT and leftover (pre-sanctions) memory from Samsung.

Just like the rest of the world, including the US (Intel, Micron), SMIC are currently using ASML lithography equipment (DUV, not EUV), but Shanghai Aishengna are now moving into early production with their own DUV machines, with SMIC and CXMT as early customers.

There is also a state sponsored Chinese EUV development underway.

HarHarVeryFunny··on A warning about 'model welfare'
Are you imagining that an LLM tasked with predicting a game continuation is going to play to win instead?
HarHarVeryFunny··on A warning about 'model welfare'
No, there is no reason for you to listen to me.

Go ahead believing rocks are conscious if you like.

Do you go out on weekends asking people to stop abusing rocks?

Rhetorical question - I don't care what you do on weekends.

Bye!

HarHarVeryFunny··on A warning about 'model welfare'
Nobody is evolving transformers. They are basically the same today as they were 10 years ago, other than a few computational efficiency changes.
HarHarVeryFunny··on A warning about 'model welfare'
An LLM will learn anything that helps it predict, including the emotional state of the writer - that is expected.

If you give an LLM the move sequence of a half-played chess game and ask it to continue as white or black, then it has learnt enough to model the ELO rating of both players and will continue playing at that level. It is not playing to win - it is doing what you expect and predicting as well as it can - it predicts the 1500 ELO player will keep playing at that level, and generates moves accordingly.

An LLM appearing to exhibit an emotion (if we anthropomorphize it and read emotion into it's output) is just predicting as well as it can - if the context calls for sad output, they you'd expect to get sad output and will necessarily find that "we're predicting sadness" detector somewhere internally.

Transformers are the same as they ever were from 10 years ago, other than minor efficiency tweaks like MOE and different attention mechanisms. Training is getting more and more complex, resulting in better and better cargo cult reasoning etc, but the architecture remains the same.

HarHarVeryFunny··on I can't stop thinking about Papua New Guinea
OK, but generations of people keep drinking themselves to death.

Generations of people lived with lead water pipes and asbestos roofs.

Within living memory we had cocaine in coke, heroin in cough remedies and were giving pregnant women thalidomide for morning sickness.

Western science is a modern thing, and even now many people don't believe it.

HarHarVeryFunny··on Why I'm still bearish on LLMs after Navier-Stokes
You are talking about 2^64 being a huge number I assume ?

If not, then what are you talking about ?

If yes, then what is the relevance to an LLM playing chess ?

HarHarVeryFunny··on A warning about 'model welfare'
> The problem is that the emergence of a sufficiently complex AI capable of suffering will likely come before we understand that we're creating a sufficiently complex AI capable of suffering.

No - suffering in an emotional state, and we'll know if we are choosing to design cognitive architecture with emotions. It's not going to happen accidentally.

> Would that argument ever hold up for humans or animals?

Why don't you hit your thumb with a hammer, then report back ?

HarHarVeryFunny··on A warning about 'model welfare'
> You can't even prove that the rocks in my backyard aren't conscious.

Sure I can, but that's because I have a well developed theory of what consciousness is, and the fact that you are entertaining the possibility of rocks being conscious tells me that you don't.

If everything is conscious, including my coffee cup and the toast I had for breakfast, then I guess we can cross consciousness off the list of things we need to worry about in terms of AI rights.

And no, I don't want to discuss what consciousness is. Maybe there is a thread for that somewhere else, but don't look for me there either.

HarHarVeryFunny··on A warning about 'model welfare'
> How do you know it doesn't have qualia?

Tokens in, tokens out. Where do you think the quale is - layer 42 ?

Seriously, do you realize how simple and NOT brain-like a transformer is ?

An LLM telling you it fears death is predicting some sci-fi trope it was trained on - maybe something you wrote yourself.

HarHarVeryFunny··on A warning about 'model welfare'
An LLM is just a Transformer - a statistical predictor. Don't be confused by the fact it talks like a human - it is a software function that is designed to copy human training samples.

Maybe one day we'll build an artificial brain or embodied artificial animal with the requisite moving parts to be conscious, have emotions, etc, but that's probably at least 50 years away, even if it were being pursued; and it may turn out to be one of those sci-fi future ideas like the Jetson's world of flying cars that never materializes because its impractical and there is no real demand.

If people are willing to think that an LLM is conscious, then why would anyone spend billions/trillions of dollars to build an AI that actually is conscious? What would be the point?

HarHarVeryFunny··on A warning about 'model welfare'
AGI vs narrow AI is just a matter of generality (robustness - removing the fragility of being good at some things and awful at others). So far the biggest markets for AI (LLMs) are coding and business automation, two areas where you very much just want something reliable and without fake opinions and personality.

There is a market for ChatBots with personalities (and it always amuses me that the inventor of the transformer, Noam Shazeer, saw this as the greatest business opportunity for them with his character.ai), although from what we've seen this can be highly problematic, and in fact China has just banned "AI girlfriends and boyfriends".

HarHarVeryFunny··on A warning about 'model welfare'
Most of the bullshit around AI would be avoided if people called it what it is. Call a language model a language model.

If tomorrow we design something better, then give it a new descriptive name.

People read AI and AGI and their brains seem to flip into sci-fi fantasy mode, thinking that they are talking about aliens, not transformers.

HarHarVeryFunny··on A warning about 'model welfare'
You can't hurt a software function, or kill it. It's not like an animal - it doesn't have a body - it's bits stored on a disk.

There is no need to give rights to something that's can't suffer or be killed.

Maybe one day we'll build artificial animals complete with emotions, and should think about that carefully, but today all we've got is language models.

HarHarVeryFunny··on A warning about 'model welfare'
The model doesn't have a view of it's own. It's a predictor of other people's views (training samples).

It's not even giving you the consensus of the training data (although it's often harmless to think that it is), but rather predicting a response to your input, and if your question steers it too much then you've just become part of the answer.

HarHarVeryFunny··on A warning about 'model welfare'
> Any AI you train is going to have goals

In the spirit of the article we're responding to, there is no need to anthropomorphize language models and say they have goals when they don't.

The RL training process tweaks the weights of an LLM to make it behave as if it were reasoning and/or had a goal, but it doesn't. It would be like saying that a cart horse, fitted with blinkers and heading for the church, has a goal of going to church.

HarHarVeryFunny··on Dream-RSI: Recursive Self-Improvement through Evolving Worlds
AGI and RSI are both meaningless terms, meaning whatever you choose them to mean.

RSI is the new sexy. Models are RSI-ing themselves towards the singularity, these folks' agents are RSI-ing themselves towards mastery of their training environments, and my pet cat is RSI-ing himself into the best cat that he can be.

HarHarVeryFunny··on Why I'm still bearish on LLMs after Navier-Stokes
> They can't possibly remember even a few positions.

Sure they could, but that's irrelevant.

A chess position is just a matter of remembering what piece number is on each square - just a list of 64 numbers. A trained model may store a trillion numbers (weights). It could store a TON of chess positions if it needed to.

However, that's not how LLMs work. They don't memorize inputs - they predict them, based on discovering predictive patterns, and those predictive patterns are not input patterns (e.g. board positions). They are deep patterns (maybe 100 layers of abstraction removed from the input), representing partial inputs, generalized across many training samples.

> Don't you know the legend about rice grains on a chess board?

Sure, but this has nothing to do with chess, and nothing to do with how many games were in the LLM's training data.

> The claim here is not about intelligence, it is about generality. There's no doubt for me the LLMs are intelligent.

Intelligent humans created the training data, and the LLM attempts to predict (copy) the training data, so of course it looks intelligent. If I say "E=mc^2", does that make you think I am Einstein?

HarHarVeryFunny··on EU chief opens door for Canada to become 'associate member'
> Never you mind that millions of Europeans live in America and that doesn't happen in reverse

America may have been founded by Europeans, but nowadays most immigrants are from countries like Mexico, India and China. You won't find any European country in the top 10.

There are about 5 million Americans living abroad, lead again by Mexico.

HarHarVeryFunny··on EU chief opens door for Canada to become 'associate member'
The monarchy is essentially ceremonial in the UK too - the position gives the monarch a platform for advocating for inoffensive things like the environment, and the pomp of state visits is perhaps sometimes useful, but the monarch really has no wield-able political power despite technically being the boss and inviting the winner of elections to run the country.

As an ex-Brit I was always pro-monarchy, enjoying the pageantry and historical continuity, although the current crop of royals don't have much going for them. Perhaps William will turn out OK.

HarHarVeryFunny··on Why I'm still bearish on LLMs after Navier-Stokes
It would be more impressive if they could play chess (or do anything they haven't been custom RLVR trained for) by reasoning, rather than just "have a go at it" prediction which is closer to memorization.

HOW you do it makes a big difference in how you should assess the capability of the thing doing it. Stockfish will trounce any LLM, and any human, at chess, so should we say that Stockfish is smarter than both?

HarHarVeryFunny··on Why I'm still bearish on LLMs after Navier-Stokes
It depends on what you are selling it as.

It only matters if you are claiming it to be general purpose.

If you admit that it's just a collection of narrow capabilities - whose strength is mostly confined to the 1000 or so RL environments it was post-trained in, then there is of course no expectation of it being general purpose.

The AI companies seem to heavily want you to believe it is some some near human level general intelligence, so therefore pointing out all the things it can't do is very relevant.

HarHarVeryFunny··on Why I'm still bearish on LLMs after Navier-Stokes
An LLM has been trained to do everything it does blindfolded, "only" using perfect recall of everything in it's hundreds of thousands of steps of context, and hundreds of layers of KV cache. It's a computer - it has a massive advantage over a human.

The fairest apples-to-apples comparison of an LLM whose training data included chess games would be a trained human such as Magnus Carlson, who can quite happily play a dozen or more simultaneous blindfold chess games.

HarHarVeryFunny··on Why I'm still bearish on LLMs after Navier-Stokes
A Transformer has a massive amount of state - it's entire KV cache, in addition to the user asking it to draw the state after every move, which is really unnecessary.

A human, at least a trained human (for fairer comparison to an LLM whose training data contained a ton of chess games) can absolutely do this - have you never seen demonstrations of expert players playing a dozen or more games while blindfolded?

A Transformer/LLM is not a human of course, and the way it will by default play chess is by prediction, not reasoning. An LLM actually does surprisingly well if you only give it the most recent 20 moves of a game where 40 moves have been played so far, since the moves NOT played tell it just as much as the ones that were played, letting it effectively infer a lot of what is on the board.

HarHarVeryFunny··on I can't stop thinking about Papua New Guinea
If individuals share some genetics, and evolutionary selection pressures act on genetics, then it follows, right ?
HarHarVeryFunny··on I can't stop thinking about Papua New Guinea
I think it's most accurate to say that selection works at the level of genes (or combinations of genes), not of individuals, and of course many individuals of a species will share some/most of their genetics.

You can tell it as a story (easier to teach) of individual success in surviving and having children, which isn't wrong, but it's also not the big picture.

HarHarVeryFunny··on I can't stop thinking about Papua New Guinea
Fundamentally evolution is selecting for genes, not individuals, and there is no 1:1 relationship between genes and individuals.

Let's say that everyone has a skin color gene that makes them either red or blue. And a new predator turns up that only eats blue things. To you this is a tale about individuals, while it seems that an equally valid, and frankly preferable, view is this this isn't about individuals - it's about being red or blue and is a species level effect.

HarHarVeryFunny··on I can't stop thinking about Papua New Guinea
> If you are a male and you only get one chance at mating, you will probably fight to the death

This is the comment I was responding to.

The question was about pre-mating death matches between males, not post-mating snacking behavior of females.

← PreviousPage 11 of 34Next →