1,919 karma · joined June 15, 2021
The short to medium term future seems more likely to look like a bunch of hikikomori living in miserable conditions and doomscrolling online.
You have to realize, we might soon (in a decade or two) reach a point where people will say things like "Oh, you want to go study science/engineering? Why?". It might literally become the dominant viewpoint that studying these things is useless. If the accelerationists have their way, they won't want humans to do any engineering, they will say that this is the job of machines, and humans can only do harm if they do engineering. That's not going to encourage kids to go try to learn those skills.
My message to the HN community: HN is literally bankrolled by YC. If Crystal doesn't deserve to exist because other languages exist, why exactly should I care about your bullshit uber-for-dogs startup, or whatever not particularly original AI crap you think you're changing the world with these days? Get real. If you want people to be open to your ideas, maybe you ought to make an effort to be open to the ideas of others, and cultivate a climate where discussing different ideas is possible. Don't treat every HN post as an opportunity to opine on how you think the work of other people is flawed.
So, even if you, as a mathematician, had access to the latest models, you couldn't afford to compete with these big labs. This is going to be one of the bigger problems. AI is a tool for massive centralization of power. That's the biggest issue. Beyond taking away a lot of people's sense of purpose, we're also talking about massively devaluing human labor... Which until now, has been the only thing you could hope to trade for money to house, clothe and feed yourself. On X you'll find a lot of people calling this take "doomerism", but the thing is, I think most people can't realistically hope to ride the AI wave into becoming rich. It's like... The pressing question is, how close are you to being able to retire?
In this case I would imagine that they probably embed your input data into a vector space, and they embed your questions/outputs into another space, and manage to predict probabilities/classes/scores for your outputs very quickly. Embedding the output classes/questions into a vector spaces gives you something you can reuse across runs cheaply, as opposed to an LLM where you can prefill the KV cache but this is an expensive operation in terms of memory.
In the medium to long term, Trump is very old, his approval ratings are in the toilet. I hope that the democrats do well in the midterms and put up a viable candidate to beat him next election (if he's still alive). I also hope that the republicans manage to put up someone smarter and less morally reprehensible next time. Because I mean, this guy doesn't actually represent any kind of conservative ideal in any way. The only people he appeals to are those one or two standard deviations on the left of the bell curve.
If the next US president is halfway sane, Canada and the US will likely begin to repair trade relationships, but I think that Canada and the rest of the world will be a bit more careful next time. The US may never regain the international standing they enjoyed before. Trump has made China look like the more stable and rational trading partner, and accelerated the decline of the US.
That being said, IMO no website should be able to freeze your machine. This is a bug. Steps should be taken to fix it.
And yeah, for NPCs, this model and their other A1B model can fit inside of a game and run at a decent speed on CPU-only. It would probably be workable for game characters.
So at some point you have to trust that the tech is safe. Both in terms of "robot won't go off the rails", but also in terms of hostile actors can't remotely take over your robot while you sleep.
In terms of sleeping, personally, I would like for the law to mandate that robots must have a physical off switch, in a very visible location, that physically disconnects power. The switch should be illuminated while in the ON position. What makes me a bit pessimistic there is that we don't even have laws to mandate webcam indicator lights (e.g. a very tiny red LED) must be ON in hardware.
In other words, can AI tech help? Probably, but I doubt it's going to be a major money maker, and it won't make a ton of money overnight. It's not like Claude Code where every programmer can begin using it instantly.
Not all of the memory usage is the fault of Bun/JS. Some of it is likely memory leaks (holding on to data it shouldn't). However, some of the blame does go to using JS. In Rust you can tightly pack your data if you want to, but in JS you can't have nested structs for example. Every object referencing another object is two separate chunks of memory, each with a header, and a pointer from one object to the other. GCs also use more memory. The overhead adds up.
Building a CLI program in JS is a bad choice, and nobody should be defending this decision. Especially since Claude Code is very much able to write Rust code, and they've shown it can port code. Just port Claude Code to Rust directly.