Remember that the entire mantra of "productivity is a measure of how many shovels you break and replace" is only ever echoed by the one selling the shovels.
568 karma · joined February 22, 2013
Remember that the entire mantra of "productivity is a measure of how many shovels you break and replace" is only ever echoed by the one selling the shovels.
If the snake oil isn't working, it's just because you haven't drank enough of it yet
and if I can deposit funds, make "investments" (gambling or not.. to me most stock investments are gambling anyway since they pay out in dividends based on quarterly profits) and withdraw money, that is at it's core a bank.
However, in these and many other cases they are now effectively unregulated ones. Partly because the executive branch responsible for said regulations have their hands in the pie.
Current LLMs are absolutely stupidly inefficient on this front, requiring virtually all human knowledge to train on as a prerequisite to early-college-level understanding of any one subject (granted, almost all subjects at that point, but what it has in breadth it lacks in depth).
That way instead of training millions of TPUs on petabytes of data just to get a model that maintains an encyclopedia of knowledge with a twelve-year-old's capacity for judgment, that same training set and compute could (they hope) instead far exceed the depth of judgement, planning, and vision of any human who has ever lived (ideally while keeping the same depth, speed of inference, etc).
It's one of those situations where we have reason to believe that "exactly matching" human intelligence is basically impossible: the target range is too exponentially large. You either fall short (and it's honestly odd that LLMs were able to exceed animal intelligence/judgment while still falling short of average adult humans.. even that should have been too small of a target) or you blow past it completely into something that both humans and teams of humans could never compete directly against.
Chess and Go are fine examples here: algorithms spent very short periods of time "at a level where they could compete reasonably well against" human grand masters. It was decades falling short, followed by quite suddenly leaving humans completely in the dust with no delusions of ever catching up.
That is what the large players hope to get with AGI as well (and/or failing that, using AI as a smoke screen to bilk investors and the public, cover up their misdeeds, play cup and ball games with accountability, etc)
Edit: I am not asking whether ChatGPT is better than Google Search, I am asking after the standard dodge of citing one's sources.
No, but that sounds good. :D
Well.. except that I never want either of those. So sometimes I want Kate editor and sometimes I want Akelpad.
Because I have a nickel I can sell you, and you can flip it an impressive number of times.
Jargon is basically just a DSL on top of English :)
I would say we have certainly seen a bottleneck in the ability of LLMs to handle any kind of broad abstractions or master the architecture of coding. That is the hinge of why "vibe coding" is as trashy of an approach as it is: the LLM can't cut the mustard on any actual software design.
So they have nothing close to the deep understanding required to improve their own substrate.
They can be exceptionally good at understanding what humans mean when they say things, far better than poking keywords into a google search for example, especially when said keywords are noisy and overloaded. And they can be a very good encyclopedic store of concepts (the more general the idea the less likely they hallucinate it, while the details and citations are far more frequently made up on the spot). But they suck at volition, and at state representation (thanks to those limited context windows) which cuts them off at the knees if they ever have to tenaciously search for anything including performing creative problem solving.
We do have AI models which can get somewhere on theorem proving or protein folding or high level competitive game playing, but those only sometimes even glancingly involve LLMs, and are primarily custom-built amalgams of different kinds of neural networks each trained on specific tasks in their fields.
None of that can directly move the needle on actual AI research yet.
Thus they are encouraging amateur third parties to pick up some of the archival slack, that style of torrent could outlive IA in case anything happened to them, and it reduces some of their bandwidth costs
I have never been creeped out by these kinds of areas or vibes, instead finding them endlessly comforting and wicked fun to explore :D
I think one possible difference about how I view such an area vs the youth of today, is I think they view walls as "the boundaries of a video game map, so sturdy that gunfire and C4 can't even dent them, thus ineffable". But I had seen enough damaged and unfinished drywall and poorly constructed buildings in my youth to instead view the wall as another piece of furniture. Beyond it is something else, possibly "outside". I don't have to bust it down, but I built faith that if you walk around it you will arrive there all the same.
And as far as an environment constructed for humans: chairs, tables, doorways, but no humans present to occupy said environment, I just wind up personifying the furniture or imagining ways to use a space for which it might not have been originally intended. After all I explored these spaces since I was a child, you damn well know my first instinct is "climb up and over all of the things" and "establish a fort" and things like that! :D
Your perspective sounds like the concept that space in a room does nothing for you until/unless you cram it full of hoarded items.
I think it might be more cognitive load than it is worth to expect everyone en masse to learn another single-line-punctuation-driven-language to perform everyday tasks with.
How "Many users" though?
I would argue that the segment of the market whose purchases incentivize personal responsibility on their PCs is outweighed by the segment of the market blowing their disposable income on tablets and smartphones who just want things to work and want whatever they see other people using on social media.
We both know which segment of the market the large companies want to win that battle. They want to sell rented compute resources through nothing but impossible-to-locally-administrate devices where every sensor spies on you and it's impossible to store any data or documents locally, let alone privately.
Even One Drive is pushing hard to literally erase your hard drive and only host your documents on their servers.