70 karma · joined May 21, 2024
100%
> arguably a more malicious crime against animals and the planet
Personally disagree, it entirely depends on your moral and ethical alignment though, of course. Generative AI will be used to divide and conquer us at a pace never seen before, it will destroy the internet/digital realm by burying it in generated content.
Its almost like... it was inherently designed to be as addictive as possible?
When programming a feature, you are simultaneously doing at least four things: 1. Implementing. 2. Building highly detailed mental models. 3. Learning and expanding your skillset. 4. Quality control and scope limiting.
And this process can be iterative and dynamic. Writing massive, super detailed specs that you then hand off to a undeterministic model feels like doing step one and three, while skipping two and four, which you then have to do after. What is the benefit? The speed up, in my opinion, comes if you skip step two and four, but then your product WILL be worse. Feels like I am going crazy?
Programming was never the bottleneck for software dev?
I am not saying that LLM intelligence can not be the same, that they are uncapable of dicovering new fields/problems that they have no training on. I am just pointing out that historically it kind of "must" be true that humans are capalbe of this, but we have yet to see an LLM do something like this, something radically "new" in a sense. All of these breakthroughs appear to me (not a mathematician) to be more a case of "digging" through millions of existing attempts/work, patching it together into a result.
This would already make LLM's one of the greatest tool mankind has ever made, but it has yet to display what I would consider a necessity for human level intelligence, which is this ability to discover entirely "new" things.
Would an LLM, given enough time and only the currently available trainingdata with no further input from humans, be able to solve something that was discovered tomorrow?
For humans my answer would be: maybe, probably, because this has been done historically.
For LLM's I would not be comfortable in claiming that they could. I think they would not be any better at this than traditional computational bruteforce.
If an entirely new problem, within a new field of mathematics were to appear tomorrow, I highly doubt an LLM would be useful at all on their own. Is this the «ultimate ASI test»?
I’m running Qwen3.8-27B-Unleashed UD-Q3_K_XL, which is a ~12.3 GiB Q3 quant, fully offloaded to the 16 GB 9070 XT. I disabled the vision projector to save VRAM and use one inference slot, Flash Attention, Q4 KV cache, --fit off, and --ctx-checkpoints 0. I’m running it with a 64K context window. The AMD driver also needs to be recent enough for ROCm 7.14; I targeted Adrenalin 26.6.4 or newer.
It is nothing short of profoundly ironic to quote Jean Baudrillard in this context.
This has, in my opinion, likely been the primary vector in getting better models thus far, but MIT mathematically proves that it yields diminishing returns for each new dimension added. It will get more and more expensive and the cost-return will or probably already has made it infeasible.
Ilya appear to support sentiment this as well. [1]
[0] - https://openreview.net/forum?id=knPz7gtjPW [1] - https://www.businessinsider.com/openai-cofounder-ilya-sutske...