1,306 karma · joined April 14, 2018
Sure, politics colors many people's worldview and it's hard for them to put it in a box - that means we shouldn't try?
In a better world, we'd focus on critical thinking, being less sure of yourself, openness and active listening. We'd teach people to work to think objectively and to identify the differences between technical opinions, emotional and political ones.
We wouldn't say "well, this is hard, so let's just do whatever".
So, not sure that counts as "serious" in your estimation, but I would definitely argue that dynamically typed languages are superior for a large class of problems.
Also, just a tip: it's usually better to be less sure of yourself, and seek to understand other's reasoning. It'll get you a lot farther than trying to convince everyone of how right you are.
If you're not sure why an experienced developer would hold an opinion different than yours, why not just ask?
IIRC if you build it yourself it's pretty much all AGPL, with few limitations.
The author claimed that once you corrected for this, the blue zones pretty much all disappeared.
Edit: found it [1]
[1] https://fortune.com/europe/2024/12/14/are-blue-zones-myth-ex...
I don't think the future is massive data centers running at a staggering loss to generate questionable code.
The future is rethinking IDEs to have local models work in partnership with the developer to ease tedium and catch mistakes.
A model that maintains a visual, zoomable mind-map of the entire project, with two way binding. Code can be created visually or textually, same with data flows.
Project structure and architecture are presented in high-level ways, that can be easily altered and refactored with almost zero tedium.
I think we start using AI for what it's good for: pattern matching and transformation, and stop trying to make it reason and pretend like it's a human.
Once we, as an industry, figure this out we'll unlock a massive boost in quality and productivity, but it looks like there will be some painful times ahead before everyone realizes that the token extrusion machines are only increasing the total cost of ownership, and they are being used incorrectly when we try to outsource our thinking to them.
I think there's an enormous opportunity to build these tools right now, and that whoever nails it will win.
If your argument is that LLMs are more effective and less costly than typical low-quality outsourced code, I generally agree with that, depending on the details.
For prototype/POC stuff, absolutely.
For long term deployable product stuff that needs to be maintained, supported with SLAs etc... eh, like everything, it depends on the people/team.
I've been leading dev teams for around 25 years, and I tend to think in terms of total cost of code.
Cognitive debt is a real thing. The cost of a developer that leaves the team, and the struggle to have someone take over their work is real.
With LLMs you have all this hidden cost, plus no "theory of mind", which makes the cognitive debt much worse.
Combine that with atrophied skills, subtle bugs, architecture facepalms, security issues, etc... and the total cost of LLM generated code is a lot higher than just a subscription price.
But since you bring it up, those of us that have been around a while have used many code generation tools that took care of tedious work like model creation, forms, validation, class creation, CRUD, component creation, project skeletons, starter templates, visual design tools that generate code, etc... etc... basically most of the stuff that LLMs are good at. Simple things that are tedious and don't require much thought - the sorts of things that statistical pattern matchers like LLMs are good at.
The rest of it, the stuff that requires thoughtful architecture and reasoning is where LLMs fall flat and mostly end up costing time. The research supports this.
So yep, my face is indeed quite straight.
How?
Do you mean by AI? I haven't seen any evidence of this.
It was always possible to get code generated at large volumes for low cost (offshore/outsource market) but we didn't see this upend or replace many (if any) software companies. In my experience it had the opposite effect - companies that replaced talented internal teams ended up suffering.
LLM generated code is similar, but arguably more expensive and lower quality.
We don't see LLM generated product replacement at scale because code generation is a problem, but it's not the only problem. Low quality can kill a product, but high quality doesn't guarantee success.
There's an entire ecosystem around a successful software offering. An ecosystem that depends on adequately functioning code.
LLMs may be useful for certain tasks (...maybe... - we've always had good options for repetitive code generation) but I certainly wouldn't describe it as "very easily replicable".
"Research over the past decade has demonstrated two co-occurring patterns of spaceflight effects on the brain and behavior: dysfunction and adaptive plasticity. Evidence indicates the spaceflight environment induces adverse effects on the brain, including intracranial fluid shifts, gray matter changes, and white matter declines. Past work also suggests that the spaceflight environment induces adaptive neural effects such as sensory reweighting and neural compensation."
But that's just a single example. The effects of gravity (or lack thereof) on the brain are widely studied, it's pretty easy to find.
Besides, that's all sort of missing the point. I chose gravity as an example of a "huh, I never really thought about that" thing that affects cognition to illustrate the point that there are a gazillion things that impact human cognition, from cat parasites [1] to prescription eyeglasses [2] not to mention all the obvious things like gut health, diet and sleep.
Our brains and bodies have an essentially infinite number of inputs that affect our reasoning - I don't think this is practical, or even possible, to model - and I don't think you can achieve human level reasoning without it.
You can't separate the package from the wrapping when dealing with the human mind. Our biology is our cognition.
[1] https://pmc.ncbi.nlm.nih.gov/articles/PMC1635495/
[2] https://mindeye.com/eye-opener-prescription-glasses-can-affe...
Most of the people that I follow that research this stuff at the doctoral level say that they (and modern science) have very little idea about how consciousness works, the mind, and its relationship to the physical parts of the brain.
We know about a lot of relationships, we can damage parts of the brain and see that damage expressed through changed behavior, but there appears to be far more to it than just a wet neural network of synapses and neurotransmitters that can be accurately modeled with a set of floating point numbers.
Also, as an aside, gravity plays a much larger role in how the brain operates than may be immediately obvious [1].
There's an open question about whether this is theoretically possible, but it doesn't seem like it to me.
Human generated data is an effect of reasoning. Attempting to extract executive function from it is kind of like taking an anti-derivative of a function.
This has always seemed like the root of hallucinations to me. It sort of follows the parallels to lossy compression that a lot of people draw. You're extracting some characteristics by observing the relationship between tokens, and then trying to argue that those characteristics are equivalent to the thing that generated the original tokens.
Surely there's some sort of overlap there, but viewed that way, it seems obvious that more and more parameters and scaling won't solve the fundamental problem. There's only so much meaning you can extract from token relationships.
It's like trying to derive the shape of a flame from the smoke it produces.
The original intelligence that created those tokens was driven by a whole universe of inputs, from hormones to starlight to gravity, not to mention all of the strange things about consciousness and parapsychology that is so poorly understood.
The machines are definitely useful for a certain class of tasks - those that don't require much executive function, and the useful work mostly involves pattern matching.
The problem is, we seem to be mistaking effect for cause and imagining that these things have greater capabilities than they'll ever posess.
The investors that don't understand this are indeed going to learn a bitter lesson.
The problem is that the wrong eyes are seeing it.
We need these kinds of articles to be published in places that executives read, and tailored to their audience.
AI recovery is going to be a big wave of consulting over the next several years, maybe very publicly or maybe quietly, but it's going to be a thing. That doesn't mean "all AI is bad" or any other such nonsense, it means that there are a lot of companies out there right now that are doing it wrong and will need help.
The executives that get ahead of this are going to be the winners.
If a human can't be bothered to write a piece, I can't be bothered to read it.
If LLMs were truly able to replace me, I'd be disappointed, sure - I've spent 30 years developing mastery of a craft, it's sad to see it go. But I'd resign myself and move on.
But that's not what makes me mad.
I get angry because I simply don't believe it is true. I have a reasonable math and tech background to where I grok how this stuff works at a fundamental level, and I'm utterly unconvinced that it is performing any sort of reasoning.
Call it a stochastic parrot, a token extrusion machine, whatever, but these things are not thinking or reasoning.
That doesn't mean they aren't useful- they clearly are very useful for many tasks.
My anger comes from the global attempt to replace things that require human reasoning with LLMs.
There's this push to use this stuff way past the point of "helpful accelerator" to "why do we need programmers/doctors/lawyers/etc..."
I think it's incredibly dangerous.
So while the tool is useful, I don't think we've figured out how to use it appropriately. For all the short term appearance of productivity boost it provides (whether this is real in a total-cost sense is still an active question), I think the risks to skill development and quality outweigh those benefits in many cases, and are being overlooked.
One day a few years ago my dad came by and was admiring it (it was a QS8) and asked to borrow it so he could play piano again.
I, of course, said sure, but was feeling a little salty about it inside, because I wanted it to play, that's why I had it all set up.
Anyway, about a year went by and I asked him about it to see if he was done with it.
He said "oh that thing? I gave that away, was just taking up space"
-.-
I don't know. I used to agree with this, but after the umpteenth time of Claude recommending some obsolete or dead old library, old version, getting major version breaking changes dead wrong, writing code for it that's not even API compatible with the published docs, etc... I started to question whether it was actually faster. I end up pouring over the original documentation anyway.
I have learned some new things, been exposed to some new techniques, and learned about some new libraries, so it's hard to tell.
The problem is made worse by so much of the internet being AI slop now, traditional searching is a huge time waste too.
Looking forward to the next chapter of tech where we're able to use these tools appropriately and not destroy everything of value with them.
She'd heard that if you made a video game and sold it, you would make a lot of money, so she'd decided to take her life savings, $200k, and hire someone to make a game. She didn't know what kind of game or anything, just "make a game".
I was really worried about her and spent two hours on the phone with her trying to educate her and help her protect herself and her savings.
At the end, she just got sort of mad at me and I could tell she was just going to get someone else to do it.
Was so sad. Wish I could have helped her more.
The companies that agree with you will be at an interesting place when they have piles of AI slop code and no talented developers.
He told me they are massively pulling back on the AI stuff.
Right now the lashback is about cost, because that's the most easily measured pain point.
Soon, we'll start seeing a deeper understanding of the quality issues. At that point, it's likely this whole experiment gets firmly put in a bin of the toolbox where it belongs.
One idea is that maybe it could figure out how many L's are in the word "google" [1]
Or, maybe which days of the week have a "d" in their spelling [2].
In the meantime, these [1] are pretty funny.
For an example, look at some of Julia Mossbridge's work.
If even a small part of her work is true and valid, it points to something far outside our current framework.
You don't need to go as far afield as Mossbridge, though - that's an extreme example. Pretty much any modern neuroscience will make you question a lot of assumptions, at least it did for me.
I don't think they include areas where correctness, determinism or human reasoning are important.
At least, not in isolation.
Decision making can be done by trained machines following rules, but that's different that reasoning. A thermostat isn't reasoning when it decides to turn on the air conditioner, to argue otherwise expands the definition of "reason" to be so broad that it becomes useless.
LLMs are trained on human knowledge and reasoning that results from human cognition, and they are excellent at stochastic mimicry - if the argument is that they are actually reasoning, then some sort of equivalent to human cognition must be present for that to be true. Lacking that, they are nothing more than "token extrusion machines" with some potentially useful characteristics.