Either people are being really, really silly (which cannot be discounted), or the potential reward is so high as to override whatever qualms a normal person must have. Is that it? Is this people looking at a solid career at Apple or sudden millions from OpenAI, and thinking the risk is worth it somehow? Or, more darkly, is it people thinking _this is my only chance and I have to take it_? Or is it trickle-down lawlessness?
I think this is the thing. Companies have always been forced rather against their immediate interests into the cost of hiring junior engineers. As soon as the idea gained traction that this cost was unnecessary, companies stopped. So: we had the post-COVID tech slump, and then immediately after, by horrible coincidence for prospective junior engineers, LLMs turned out to be good at coding. Result: a missing generation of engineers, and a giant headache in about 15 years time. But which tech exec could possibly care about what happens in 15 years?
I'm about to get a junior engineer to work with at my Big Tech company. This used to be normal, it's now slightly extraordinary. I've not worked with a junior engineer in literally years. Even typing this, I think: this must be hyperbole, it's true though.
It's the Silicon Valley circular-reasoning meritocracy in action: those with the billions deserve to have the billions because they have managed to get the billions. Every extra dollar only goes to prove how little they need to listen to those with less.
Kind of serious question: in tech circles is the Manhattan project generally seen as a _good_ thing, these days? Why use it as the example and not, say, Apollo? "We're working really hard so we can build things with the power to kill you all" is such weird messaging.
Hmm, also saying the scale is 0 to 5 is... something. In my experience, which was a while ago, no one cares about SEV 3, and I only ever saw SEV 4 used as a placeholder or TODO list. Never came across a SEV 5 in the world. It's really "SEV 2 on a scale of 0 to 3".
I'm sure it's about power. I am also sure that having that much wealth, that little accountability, being surrounded by people who've a vested interest in telling you you're a genius, would make anyone go a little insane. Call it Roman Emperor syndrome. Not many people can be Marcus Aurelius.
There's being fed up with something and there's fomenting civil war. The huge wave of immigration, which has since subsided, happened under the Tories.
One solution is not to advance anything of course. I'm not even joking, is there going to be a successor to React? I suspect not, with the vast amount of training data for React now, it's going to look silly to move to something else with less support. What is the last new popular programming language, rust? Will there be another one? I suspect not. Same reasoning. The irony of all this AI acceleration talk is it'll work best if we don't accelerate the underlying tech at all.
The Stasi had one informant per 6.5 people. We're moving to a world in which everyone can have their own personal informant. I really don't think I am being hyperbolic here.
I think this gets to the conflation we naturally have with consciousness and a sense of self. Does a tree have a sense of self? I imagine probably not, a tree acts more like a clonal colony than a single organism.
I'm mainly saying it's impossible to know, at least without a theory of consciousness that doesn't exist. Do we consider bacteria to be conscious though, is there something like to be a single cell? I can easily believe there is something like to be an insect.
One question I am genuinely wondering about is whether a self-driving car _is_ cheaper than a human driver, once all of the externalities are priced in. In SF right now a Waymo is typically priced a little under an Uber (actually quite a bit under if you count that no one has got around to asking for tips for AIs yet). I am sure the running costs of each Waymo vastly exceed the costs of a human driver to Uber...
Current LLMs prove that the Turing Test was insufficient all along. But they also prove that intelligence != consciousness. One can, after all, be conscious without a thought in one's head. We certainly have ongoing work in identifying the neural correlates of consciousness in animals, none of which is going to be remotely applicable to machines. We're genuinely blind to the question of whether a sufficiently large neural net can exhibit flashes of subjective experience.
There's a story to tell in that:
1) Google has a transformer-based AI that hallucinates too much to release
2) OpenAI replicates the tech then YOLOs it
3) Everyone says: look how Google is getting left behind! Google thinks: the second mouse gets the cheese.
4) Google gets the cheese, OpenAI is absorbed by Microsoft or just disappears (or both).
> Going back to the analogies: This is like copying answers through university and then showing up to a job that requires independent thought.
That's exactly what is happening now. I wouldn't even call it an analogy, I'd call it an example of where AI is already having a baleful effect. FWIW I don't disagree with the article's thesis or the examples: yes, absolutely, if used well AI can elevate engineers in exactly this way and it behooves us engineers to use it in that way. We can also say that the deliberate design of the AI systems we are constantly being exhorted to use inclines them towards work-slop and abdicated thinking.
AI could be a huge net benefit, and justify large layoffs.
AI could be a huge short-term benefit, justify layoffs now, so long as you (the exec doing the laying off) don't have to worry about the long term
AI could have middling net benefit, but be a great excuse to justify layoffs now. In this scenario, the people laid off and those that remain bear the cost (one, losing their jobs; those that remain, burning out with the extra workload)
etc etc, many scenarios to consider...
Same! Every so often I remember that I can juggle, and spend a minute or two juggling, and feel better for it. And then I forget for weeks or months.
(I taught myself while procrastinating from exam revision, many years ago. I started with a large bag of oranges. Just enough of an incentive not to drop them, no real harm when they did hit the floor.)
I do find it hilarious that after all the machine learning optimizations done on people's feeds over the years, all the promos got for a 1% improvement on this metric, every E7 and E8 who can claim x% of this or that, after all of that work, we might genuinely, and not even as a joke, be in the situation of needing to throw _other_ AI agents at this selfsame feed in order to extract any real value from it. What a world we've built.
I am afraid that we are heading to a world in which we simply give up on the idea of correct code as an aspiration to strive for. Of course code has always been bad, and of course good code has never been a goal in the whole startup ecosystem (for perfectly legitimate reasons!). But that real production code, for services that millions or even billions of people rely on, should be reliable, that if it breaks that's a problem, this is the whole _engineering_ part of software engineering. And we can say: if we give that up we're going to have a whole lot more outages, security issues, all those things we are meant to minimize as a profession. And the answer is going to be: so what? We save money overall. And people will get used to software being unreliable; which is to say, people will not have a choice but to get used to it.
I'm reminded of Douglas Adams's take on video recorders as machines to watch television so you don't have to. He should have been around to see Marvin built for real!
Some years later, I interviewed at Knight Capital, just a couple of weeks before their blowup. (Dreadful interview at which I did dreadfully, being asked to write C _over the phone_ by a supremely uninterested engineer. Quite a red flag in retrospect.)
A lack of imagination on my part perhaps, but I can't think of anything I'd use it for which isn't either: 1) cheating myself and others of leisure (e.g. I suppose I could use it to fake-keep up with friends..? Or plan a holiday and book a load of stuff for me. But I like doing that!), 2) not feasible (loading and unloading the dishwasher, which is already the robot I used to wash dishes), 3) utterly insane (it's tax time in the US).
I do genuinely wonder about the endgame here. Why would the objective winners of the _current_ system, our billionaire class, want to disrupt that system? Do they really believe that they will necessarily be winners in the new world too, are they that arrogant?
What I find interesting, and reflects my ignorance of how these things are used, is that if you look at, say, FAANG companies, Office isn't used. I've worked for two FAANGs over the past couple of years, and everything is done via Google docs. Replacing a giant suite like Office looks hard, replacing something simpler like Google docs looks very much simpler, and surely should suffice?