civvv

>Or as Jean Baudrillard has said:

It is nothing short of profoundly ironic to quote Jean Baudrillard in this context.

Yarvin is a basement dweller and 4chan intellectual, high on his own supply of pseudo-intellectual takes. What is sad and worrying is that these kinds of politics are increasingly moving out of the fringe internet and into pockets of power (eg. Thiel and Vance). It is problematic that these ideas now linger only one or two steps away from the most powerful and influential person in the world.

There are many indications that model progress is slowing down, so that is not entirely accurate.

Three of my favourite game series as a kid, what a legend.

Not sure about their other departments, but at least in March there was no LLM coding in their Source2 & game teams.

https://x.com/ZPostFacto/status/2035784300575305895

I am no insider and have never even tried to build an LLM, so I can only guess. But the general sentiment seems to be that this is the case. If you are interested, I would recommend you read the MIT paper "Superposition Yields Robust Neural Scaling" [0]. It confirms an interesting trend: models represent more features/concepts than they have clean independent dimensions, so features overlap. Increasing model dimension reduces this geometric interference, which lowers loss in a predictable way, but with diminishing returns.

This has, in my opinion, likely been the primary vector in getting better models thus far, but MIT mathematically proves that it yields diminishing returns for each new dimension added. It will get more and more expensive and the cost-return will or probably already has made it infeasible.

Ilya appear to support sentiment this as well. [1]

[0] - https://openreview.net/forum?id=knPz7gtjPW [1] - https://www.businessinsider.com/openai-cofounder-ilya-sutske...

This is likely true. I think model quality has stagnated and that its likely a non-trivial task to find a new improvement vector. Scaling the width of the model (which has been the driving force behind the speed of improvement thus far) seems to have reached its limit.

It will be interesting to see the implications of this. Tooling can only do so much in the long term.

Do you understand how LLM's work and that they are always behind in their knowledge? Unless Claude does a network call to check its own website, it will give you outdated information. Its a prediction model, its not magic.

If you scroll down, you can clearly see that the Pro plan has an "x" on Claude Code now.

Does this mean that for enterprises using per-seat pricing, only the $100 premium seat gets access to claude code?

You’re generalizing too much here. One of the biggest problems with LLM’s today is in-fact that they are not at the level being advertised. This is not solely a case of regulation standing in the way of a «revolution».

Literally a skill issue?

This one was pretty fun. Had zero expectations, but left pleasantly surprised.

https://opper.ai/ai-roundtable/questions/94e19d86-cc0

Fun little toy, tried to ask it some post-modern philosophy questions and they all mostly agreed with the statements of the philosopher, until the debate where Opus 4.6 managed to change their opinion to a resounding "maybe", pretty much every single time. It seems like the "better" frontier models often take a more grounded stance from the beginning, and even manage to influence the other models.

Here is an example: https://opper.ai/ai-roundtable/questions/79e6cdd4-515

Another fun debate: https://opper.ai/ai-roundtable/questions/81ee56e9-60f

That entirely depends on what you are buying. If you’re in need of a lawyer to keep you out of the bottom bunk, I’d happily spend a lot more for a little better.

Go touch some grass, please

You do a year worth of work in 3.65 days? These multipliers are getting pretty laughable

I think you are right in that the primary mechanisms remain the same, or at least similar, but that was not my point anyways. The surrounding adjectives describe more the context of which capitalism exists within.

The effects and consequences of capitalism under feudalism or the age of slavery is, for example, fundamentally different from capitalism under a freer modern democracy. A slave or serf did not have the opportunities of capitalism, which changes how the system behaves and its effects.

The term "capitalism" becomes kind of meaningless, because it just describes a broad set of mechanisms. In the case of the question in this thread it is much more descriptive to include the context of which it exists within.

The RAG models are very competent at programming. I am worried about my job as a SWE in the near future, but didn't the MIT paper about a week ago pretty much confirm that width-scaling the model is about to (or has already) stopped giving any measurable increase in quality because the training data no longer overfills the model?

Any authentic training data from pre-LLM's is assumed to have been used in training already and synthetic or generated data gives worse performing models, so the path of increasing its training data seems to be a dead end as well?

What is the next vector of training? Maybe data curation? Remove the low quality entries and accept a smaller, but more accurate data set?

I think the AI companies are starting to sweat a little, considering the promises they have made, their inability to deliver and turn a profit at its current state and the slowing improvements.

Interesting times! We are either all out of jobs or a massive market crash is imminent, awesome...

I would be reluctant to say that capitalism, as we have had after the industrial revolution, has existed in the same form for thousands of years. That just seems silly.

10k LoC per day? Wow, my condolences to you.

On a different note: something I just discovered is that if you google "my condolences", the AI summary will thank you for the kindness before defining its meaning, fun.

I don't know. Certainly the underlying mechanisms of capitalism remain the same, but it does not hurt to clarify the context that it exists within. The world is very different today, than say the 1960's, but the "rules" were the same. Capitalism has been accelerated a lot by the rise of information technology, specifically the internet, and today it is a whole different beast with unique "opportunities" and consequences.

Online (foreign based, read: tax and regulation havens) gambling casinos are flooding the social media feeds of children with AI slop or memes that have their logo/branding slapped on it. They are posting thousands of videos per day, trying to get kids to gamble on their casinos. Who are behind? The owners of gaming communities/e-sport brands like FaZe Clan etc. Basically, if you were a large youtuber in the 2010's, the goto seems to be get in on some kind of online gambling site for kids.

>(why do all billionaires seem devoid of ethics?)

The type of person at the top of a hierarchical system is always a direct reflection of its play rules. In late-stage internet capitalism you win by being the most unhinged and un-emphatic. Today's young adults grew up on twitter, 4chan, video game gambling and with influencers telling them that the only thing that matters is material wealth and status. This culture has moved more and more into the mainstream in the last decade.

An annoying aspect today is that I can never share my code publicly without some AI company stealing it to train their models, regardless of license.

Valve has already tried this with VACNET if I am not mistaken. Judging by how big the cheating problem still is, they were not very successful.

Luckily LLM’s are nowhere near capable enough to pull this off for anything other than the likes of isEven()

ChatGPT could never

Wow, thanks for sharing. That is very cool, so much history in that part of the world. I go to Crete every other year, coasting along its southern side, many ruins of "lost" harbour towns which supposedly were large trade hubs in the mediterranean. I wonder if Silphium played a large role in their economies.

One of the great archeological finds of this decade(https://www.livescience.com/ancient-odeon-discovered-crete) was discovered in Lissus(https://en.wikipedia.org/wiki/Lissus_(Crete)) in 2022. A great hike from Sougia for those interested, the place truly is beautiful.