1,321 karma · joined May 11, 2018
I doubt this investment firm will have genuine connection in mind though.
More concurrency than that isn't really practical for me if I want to retain some semblance of understanding. Perhaps it's different for purely web app or frontend tasks, where the outcome is more relevant than the process, I don't have much experience there (and also don't want to belittle these domains, I might be underestimating their complexity).
So surprisingly, my own work is at least for the time being almost saturated by the model capabilities. I am not sure how I'd scale from here. Sure I could run all requests at max effort to burn tokens for the sake of it, but that can't be it. And for many tasks, I am not really able to define so clear cut success criteria or self-verification loops that I could benefit from letting an agent (or a fleet thereof) autonomously run for a day.
So I realize it's a skill issue on my side, but I can't be the only one. I wonder if there is a limit to token demand, at least short term. Feels like either they accelerate to AGI and RSI, where the AI can find uses for token, or things might plateau at some point.
Note I don't think this because I'm an AGI skeptic or think there's a ceiling to intelligence, but there might simply be a valley of economic hardship for the companies where the supply of tokens outpaces the demand, due to a lack of ideas of what to do with them. And this might slow down the funding enough that they never reach escape velocity with the training run scaling. But we'll see.
It wouldn't be so bad if you could just sit it out and say "Oh well, once the labs get bored with marketable domain X, humans will remigrate and re-apply creativity to it", but by then the damage might have been done and a field destroyed as an occupation. I don't know what to do about it, but I appreciate calling out the cynical tone-deafness of the AI companies here.
I guess (pure) mathematics will eventually be left alone, since own its own it is not economically valuable and OpenAI and Anthropic will eventually not need it any more for publicity, leaving the normal researcher alone to pick up AI-supported crumbs again.
But this also doesn't bode well for other domains. I think these are the clear signs of power concentration in the hands of the AI labs. All future progress will go through them, and if it doesn't, it's only because they graciously let you and decided not to scoop you first.
This doesn't seem to be clear and is very implausible for a large company. Be as cynical as you want, but a normal researcher will simply not have access rights to this data, which will be siloed away somewhere else.
It might very well be somewhat unfair to catch wind of a promising approach and then try to frontrun them by throwing compute at the problem, but this isn't really the same.
Story of European regulations. At some point you have to concede that they are incompetent and unaccountable. What do they care if they depress economic integration and growth in Europe? No one will ever be blamed for diffuse bureaucratic costs that drag down the whole Eurozone.
I even resent people giving them credit for "well, the idea was laudable..". No. Again and again they introduce make-the-world-a-better-place regulations, and whoever opposes these or asks about tradeoffs or whether they are meaningfully useful must be a crazed libertarian or industry lobbyist who wants to poison the people.
I remember how smug Europeans were about the American PATRIOT act. Who could be so stupid to be fooled by such propagandist framing of laws? Well, here in the EU that happens frequently. The commission just has to wrap its degrowth policy in saving-the-world names and off we go. (See also the EU Supply Chain Act, i.e. Corporate Sustainability Due Diligence Directive, aka expensive paperwork for a good conscience)
So yes, many aspects of my job are now 10x as productive, but turns out that improves my overall throughput only very little.
Hard to assess what this rule will actually accomplish. Ultimately AI will be involved in all creative processes going forward, so all pieces of media will have at least some basic AI disclaimer. At the same time, the bad actors that the EU is so paranoid about (Russians secretly undermining our democracy and other boogeymen) will obviously not use the label.
But it's another tool in the EU's toolkit to arbitrarily enforce fines on big tech when politically convenient, of course. That's one thing we remain good at.
But taxing inheritances would still be preferred mechanism rather than taxing unrealized gains I think. That would target the EU's unproductive rent seeking heirs the best.
On a serious note, I hope they improved their extremely sabotaging and unspecific bio safeguards, which prevented Fable from being used in any codebase that ever so slightly grazed medical terminology or data and made me switch to 5.6 Sol.
If that's the position they take then they really should be heavily regulated or nationalized. Cyberdefense against their own models dependent on their goodwill? Sure, but then they have to sell defense capabilities at subsidized rates with a limited margin. Would be very weird otherwise to take the world hostage with their models and then also sell the solution while demanding intrusive KYC.
Given how healthcare is one of these sectors that seems to relentlessly resist efficiency increases and is the prime example of Baumol's cost disease, I think any developed country with a costly healthcare system needs to do these AI experiments. The current versions will be shit, but the only way out is through if you still want to provide affordable care.
I honestly have no doubt that AI going forward will be able to do a good job at triaging via calls and also being empathetic about it. But of course it needs careful experimentation.
Do you link one with the other as a skill or mcp or so?