How do technical managers solve this problem? I've never been a real manager.
This is both like forcing all IC to develop management skills but its also like the shift to cloud infrastructure or 4GL languages - we are never going back to the old ways and will be building everything at a different level of abstraction with a different span of control.
The bad ones get promoted for spending the time instead playing politics.
Just under the surface of human consciousness, we are constantly hallucinating and predicting what we may occur next. We are good at discarding what doesn't align with our working model of the world before reaching awareness and taking action. It's our attempt to conceptualize reality. Considering how un-grounded from reality humans are becoming, the fact we have to balance our nervous systems, the mistakes we do make day-to-day, and how minor physiological changes (from poison to injury to drugs to random chance) can disrupt the process, it doesn't take much for humans to make a major mistake or enter a psychotic state.
It wouldn't surprise me if a systematic approach to solve these problems with LLMs could be applied to human/hybrid teams.
The narrative exists to justify deskilling and replacing human expertise with LLMs on the premise that LLMs are at worse human equivalent and at best human superior but the hyperbole employed to make the false equivalence sometimes borders on the absurd and occult.
>It wouldn't surprise me if a systematic approach to solve these problems with LLMs could be applied to human/hybrid teams.
What you're describing aren't "problems" that need to be "solved" in human beings. They are problems when they persist in software, but we already had software that didn't have these problems.
This is a state of being that we chose because we decided profit superseded all other concerns.
I don't "want" to believe it given the implications, nor support a profit narrative. That incorrectly assigns a frame of thought that has nothing to do with me and actually opposite to my beliefs.
We do know that a single chemical compound can fundamentally alter our perception of reality. Drugs don't contain hallucinations, they reveal our subconscious brain processes by affecting our awareness and disrupting whatever ends up in our cognition. We are constantly trying to predict what will happen next and compare outcomes to expectations, where errors and confabulations occur constantly. False memories and unreliable eyewitness accounts are a matter of fact. Optical illusions are persistent and repeatable. We're often confidently wrong when recalling memory, deducing from logic, transcribing etc., whether it's for milliseconds or decades. We also dream each night which is technically not "hallucination", but clearly a necessary reality-adjacent process.
If you break the problem down and question our ingrained societal human exceptionalism, it's clear humans actually have no real unshakable "understanding" of anything, we simply have more sensory information and reality testing in real-time to maintain a state of reality alignment. This can be affected at any time by physiological changes from illness to brain injury. Perhaps we currently maintain better context overall (reducing the volatility and frequency of errors), but no animal would exist for long and succeed if it didn't naturally do this one task exceptionally well.
Given the pace of technology and lack of evidence to prove digital machines can't outperform us at this task too, long-term it seems like a matter of time until LLM + ? = human ability superseded. At which point we may have an entirely new tool for neuroscience research, before we even have an agreed definition for consciousness.
This was all evident before LLMs reached the stage they're at now, and progress will continue whether or not companies can capture profit in a hype-bubble. The argument otherwise would be to prove that humans have a deterministic-probabilistic relationship that differs from the technology. I don't have answers but we certainly can't close these open questions when the literature and evidence points more towards similarities.
They do. It's called "stuck in traffic."
Agents fail randomly. One day a stellar dev and next a bs artist.
So this idea that LLM hallucination is not unlike human failings is without merit.
what
Entire institutions and organizations in humanity are based on this feature of human beings.
A heuristic software agent that will respond in a spectrum of possible ways and past performance is no guarantee of future performance. It is no way reassuring that your agent has 'never done x' since if 'x is in the space of possible responses' it can certainly do 'x'.
Oh I see. That is not what determinism means. Determinism means their actions are predestined, "determined" by the initial conditions. Computer programs - including AI - are deterministic, barring cosmic ray flips. The same inputs running in the same environment produces the same output.
Humans are or are not, depending on whether free will exists.
Either way, it's hard to draw the boundary around determinism such that it includes humans but excludes AI.