HNHacker News
TopNewBestAskShowJobs

morleytj

519 karma · joined February 29, 2024

https://tjmorley.com/
submissionscomments
morleytj··on Sora 2
Certainly, and that is the more pessimistic view that I have, that this is being developed with a view to introduce product sponsorships and advertisements.

I mainly am curious if anyone has the view that there is broader benefit to the development of this, after all, wasn't that the entire mission statement of OpenAI?

Quoting from their announcement on their site:

> OpenAI is a non-profit artificial intelligence research company. Our goal is to advance digital intelligence in the way that is most likely to benefit humanity as a whole, unconstrained by a need to generate financial return.

This feels like something constrained by the need to generate a financial return, and not something primarily focused on understanding physics and world models, to be blunt.

source: https://openai.com/index/introducing-openai/

morleytj··on Sora 2
You're right that the societal cost is very different. I hadn't thought about people doing the stupid things on video, I think personally I focus on the effects of the consumption moreso.

Personally I think the problem with TikTok is largely based in hyperoptimized content specialized to your interest shaping your worldview and isolating your perspective of the world from others, as well as probably being pretty bad for the ability to maintain attention and engage with long form narratives and ideas. I don't really think TikTok is unique here, other than that it's the best in the game at doing it and keeping people's attention.

But overall I suppose I just see something like this as potentially worse in those regards, but maybe I'm overly pessimistic.

morleytj··on Sora 2
Not to be a downer, but even as someone very optimistic about technology and AI generally, "TikTok but AI" sounds like a societally terrible thing to try and create.

What's the benefit of this? Curious if anyone has a solid viewpoint steelmanning any positives they can think of.

morleytj··on Tesla market share in US drops to lowest since 2017
Is it? I thought it was overtaken by the RAV4 a while back.
morleytj··on Indiana Jones and the Last Crusade Adventure Prototype Recovered for the C64
Wait, are you the person who made a prototype of Halo for the DS? That's extremely interesting!
morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
Yeah, I also tend to have heavier usage of them. I'm not exactly sure why I do though, I don't have a particular incident like yours in high school. I think I just read too many blog posts as a teenager, haha.

It is a bit of an odd repetition, right? I wonder if anyone has done analysis on usage of that construction by year.

morleytj··on Important machine learning equations
I 100% agree.

I think Shannon's Mathematical Theory of Communication is so incredibly well written and accessible that anyone interested in information theory should just start with the real foundational work rather than lists of equations, it really is worth the time to dig into it.

morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
Ah, yeah, I understand that feeling, the sensation is very unfortunate. I feel the same!
morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
That's something I find very interesting, honestly. I think the two way nature of the relationship between the impacts of a tool on humans and the impact of humans on the way the tool develops is a particularly weird little phenomenon that exists these days. It's overall fascinating.
morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
Yeah, it's clear he's going through a lot of pain. Even just going through that many job changes outside of the other events sounds painful and difficult to deal with.
morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
Very snarky, but okay, haha. Do you not get that sort of sense at all from the above structure? I'm curious if it's just in my head and what the perspectives of others are.
morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
I also use emdashes a lot. I'm more talking about the particular contrastive structure.
morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
I do also get that pretty often. Also because I've always liked using hyphens and emdashes, so I get that as well. I don't know if I'd call it "vile" to notice a common pattern like the above though.

But it does have a certain code smell sometimes, I often get it on Reddit posts as well.

morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
It's very common to see the particular syntactic structure of restating a point in the following general manner from Claude/ChatGPT in my experience and that of others:

"It's not X -- it's Y." or "This isn't just X -- It's actually Y."

Usually with an emdash there as well for the separation. As I said it's very plausibly becoming more common among people not using LLM-assisted writing too, just from seeing the stylistic approach used more often and having it spread naturally, but I do have been seeing it spread with dramatic speed over the last couple years. I even catch myself using other phrasing more often from reading it more. I think it's just part of how language spreads, honestly.

morleytj··on The cost of transparency: Living with schizoaffective disorder in tech
This is very unfortunate and I'm sorry to hear that the author has been excluded and is suffering to this extent.

On another note though:

"This isn't paranoia—it's pattern recognition honed by lived experience."

I can't stop seeing the LLM verbiage everywhere I look. I feel like once you recognize the repeated syntax that got RLHF'd into all of these models you never stop seeing it. Maybe everyone is learning those patterns from reading AI-generated language now too.

morleytj··on How does the US use water?
I guess my general question in those scenarios is why spend time and water maintaining a lawn of plants that can't grow normally in the local climate? There are definitely plants which survive in the area year round in many places in the US.
morleytj··on How does the US use water?
Lawns use such an incredible amount of water, particularly people maintaining them in deserts, like in Arizona and parts of California. It boggles my mind that people go out of their way to put so much effort and resources just into having grass in front of their house that they mostly don't use.
morleytj··on Margin debt surges to record high
It seems like this would be a pretty good argument for increasing taxes on the high end and having large public works projects to drive forward particular useful goals on a national level (ignoring whether or not a particular governmental organization is currently capable of this, more just focusing on that as a backstop that allows prioritization of economic goals).
morleytj··on Lab-grown salmon hits the menu
The argument in the comment above is that lab grown salmon cells should not be allowed to be marketed as salmon because they have had components such as beta-carotene added for coloring.

In light of the fact that similar compounds are added to the majority of farmed salmon for similar reasons, the comparison shows that the objection is likely a fallacious appeal to nature, purporting that something is good because it is "natural" or "normal" rather than presenting any objective evidence to argue their point.

morleytj··on Lab-grown salmon hits the menu
It's not exactly the same, but given that much of it is for coloring, I feel the comparison should be drawn that basically all farmed salmon in the US is specifically fed food containing astaxanthin to give it a more pleasing coloring, the same as the purpose of the beta-carotene added here.
morleytj··on Why are there so many rationalist cults?
My general disagreements with those axioms from my reading of the literature are around the concepts of immutability and of the belief in the almost entirely biological factor, which I don't think is well supported by current research in genetics, but that may change in the future. I think primarily I disagree about the effect sizes and composition of factors with many who hold these beliefs.

I do agree with you in that I generally have an intuition that intelligence in humans is largely defined as a set of skills that often correlate, I think one of the main areas I differ in interpretation is in the interpretation of the strength of those correlations.

morleytj··on Why are there so many rationalist cults?
The built in assumptions are always interesting to me, especially as it relates to intelligence. I find many of them (though not all), are organized around a series of fundamental beliefs that are very rarely challenged within these communities. I should initially mention that I don't think everyone in these communities believes these things, of course, but I think there's often a default set of assumptions going into conversations in these spaces that holds these axioms. These beliefs more or less seem to be as follows:

1) They believe that there exists a singular factor to intelligence in humans which largely explains capability in every domain (a super g factor, effectively).

2) They believe that this factor is innate, highly biologically regulated, and a static factor about a person(Someone who is high IQ in their minds must have been a high achieving child, must be very capable as an adult, these are the baseline assumptions). There is potentially belief that this can be shifted in certain directions, but broadly there is an assumption that you either have it or you don't, there is no feeling of it as something that could be taught or developed without pharmaceutical intervention or some other method.

3) There is also broadly a belief that this factor is at least fairly accurately measured by modern psychometric IQ tests and educational achievement, and that this factor is a continuous measurement with no bounds on it (You can always be smarter in some way, there is no max smartness in this worldview).

These are things that certainly could be true, and perhaps I haven't read enough into the supporting evidence for them but broadly I don't see enough evidence to have them as core axioms the way many people in the community do.

More to your point though, when you think of the world from those sorts of axioms above, you can see why an obsession would develop with the concept of a certain type of intelligence being recursively improving. A person who has become convinced of their moral placement within a societal hierarchy based on their innate intellectual capability has to grapple with the fact that there could be artificial systems which score higher on the IQ tests than them, and if those IQ tests are valid measurements of this super intelligence factor in their view, then it means that the artificial system has a higher "ranking" than them.

Additionally, in the mind of someone who has internalized these axioms, there is no vagueness about increasing intelligence! For them, intelligence is the animating factor behind all capability, it has a central place in their mind as who they are and the explanatory factor behind all outcomes. There is no real distinction between capability in one domain or another mentally in this model, there is just how powerful a given brain is. Having the singular factor of intelligence in this mental model means being able to solve more difficult problems, and lack of intelligence is the only barrier between those problems being solved vs unsolved. For example, there's a common belief among certain groups among the online tech world that all governmental issues would be solved if we just had enough "high-IQ people" in charge of things irrespective of their lack of domain expertise. I don't think this has been particularly well borne out by recent experiments, however. This also touches on what you mentioned in terms of an AI system potentially maximizing the "wrong types of intelligence", where there isn't a space in this worldview for a wrong type of intelligence.

morleytj··on Why are there so many rationalist cults?
I now feel the need to comment that this thread does illustrate an issue I have with the naming of the philosophical/internet community of rationalism.

One can very clearly be a rational individual or an individual who practices reason and not associate with the internet community of rationalism. The median member of the group defined as "not being part of the internet-organized movement of rationalism and not reading lesswrong posts" is not "religious extremist striking the world trade center and committing an atrocious act of terrorism", it's "random person on the street."

And to preempt a specific response some may make to this, yes, the thread here is talking about rationalism as discussed in the blog post above as organized around Yudowsky or slate star codex, and not the rationalist movement of like, Spinoza and company. Very different things philosophically.

morleytj··on GPT-5: Key characteristics, pricing and system card
Very interesting way of thinking through it, I agree on pretty much all the points you've stated.

That aversion is really fascinating to dig into, I wonder how much of it is cultural vs something innate to people.

morleytj··on GPT-5: Key characteristics, pricing and system card
Comment I'm replying to poses the following scenario:

"If you could just ask GPT to create a startup that'll be guaranteed to be worth $1B on a $1k investment within one year"

I think if the situation is that I do this by just asking it to make a startup, it seems unlikely that no one else would be aware that they could just ask it to make a startup

morleytj··on GPT-5: Key characteristics, pricing and system card
The benchmarks certainly seem to be improving from the presentation. I don't think they started training this 4 months ago though.

There's gains, but the question is, how much investment for that gain? How sustainable is that investment to gain ratio? The things I'm curious about here are more about the amount of effort being put into this level of improvement, rather than the time.

morleytj··on GPT-5: Key characteristics, pricing and system card
I'm pretty curious about the same thing.

I think a somewhat comparable situation is in various online game platforms now that I think about it. Investors would love to make a game like Fortnite, and get the profits that Fortnite makes. So a ton of companies try to make Fortnite. Almost all fail, and make no return whatsoever, just lose a ton of money and toss the game in the bin, shut down the servers.

On the other hand, it may have been more logical for many of them to go for a less ambitious (not always online, not a game that requires a high player count and social buy-in to stay relevant) but still profitable investment (Maybe a smaller scale single player game that doesn't offer recurring revenue), yet we still see a very crowded space for trying to emulate the same business model as something like Fortnite. Another more historical example was the constant question of whether a given MMO would be the next "WoW-killer" all through the 2000's/2010's.

I think part of why this arises is that there's definitely a bit of a psychological hack for humans in particular where if there's a low-probability but extremely high reward outcome, we're deeply entranced by it, and investors are the same. Even if the chances are smaller in their minds than they were before, if they can just follow the same path that seems to be working to some extent and then get lucky, they're completely set. They're not really thinking about any broader bubble that could exist, that's on the level of the society, they're thinking about the individual, who could be very very rich, famous, and powerful if their investment works. And in the mind of someone debating what path to go down, I imagine a more nebulous answer of "we probably need to come up with some fundamentally different tools for learning and research a lot of different approaches to do so" is a bit less satisfying and exciting than a pitch that says "If you just give me enough money, the curve will eventually hit the point where you get to be king of the universe and we go colonize the solar system and carve your face into the moon."

I also have to acknowledge the possibility that they just have access to different information than I do! They might be getting shown much better demos than I do, I suppose.

morleytj··on GPT-5: Key characteristics, pricing and system card
I suppose what I'm getting at is that if there are performance increases on a steady pace, but the investment needed to get those performance increases is on a much faster growth rate, it's not really a fair comparison in terms of a rate of progress, and could suggest diminishing returns from a particular approach. I don't really have the actual data to make a claim either way though,I think anyone would need more data to do so than is publicly accessible.

But I do think the fact that we can publicly observe this reallocation of resources and emphasized aspects of the models gives us a bit of insight into what could be happening behind the scenes if we think about the reasons why those shifts could have happened, I guess.

morleytj··on GPT-5: Key characteristics, pricing and system card
Certainly, yes, plenty of elbow grease required in all things that matter.

The interesting point as well to me though, is that if it could create a startup that was worth $1B, that startup wouldn't be worth $1B.

Why would anyone pay that much to invest in the startup if they could recreate the entire thing with the same tool that everyone would have access to?

morleytj··on GPT-5: Key characteristics, pricing and system card
I'd agree on that.

That's pretty much the key component these approaches have been lacking on, the reliability and consistency on the tasks they already work well on to some extent.

I think there's a lot of visions of what our human lives would look like in that world that I can imagine, but your comment did make me think of one particularly interesting tautological scenario in that commonly defined version of AGI.

If artificial general intelligence is defined as completed "economically valuable tasks" better than human can, it requires one to define "economically valuable." As it currently stands, something holds value in an economy relative to human beings wanting it. Houses get expensive because many people, each of whom have economic utility which they use to purchase things, want to have houses, of which there is a limited supply for a variety of reasons. If human beings are not the most effective producers of value in the system, they lose capability to trade for things, which negates that existing definition of economic value. Doesn't matter how many people would pay $5 dollars for your widget if people have no economic utility relative to AGI, meaning they cannot trade that utility for goods.

In general that sort of definition of AGI being held reveals a bit of a deeper belief, which is that there is some version of economic value detached from the humans consuming it. Some sort of nebulous concept of progress, rather than the acknowledgement that for all of human history, progress and value have both been relative to the people themselves getting some form of value or progress. I suppose it generally points to the idea of an economy without consumers, which is always a pretty bizarre thing to consider, but in that case, wouldn't it just be a definition saying that "AGI is achieved when it can do things that the people who control the AI system think are useful." Since in that case, the economy would eventually largely consist of the people controlling the most economically valuable agents.

I suppose that's the whole point of the various alignment studies, but I do find it kind of interesting to think about the fact that even the concept of something being "economically valuable", which sounds very rigorous and measurable to many people, is so nebulous as to be dependent on our preferences and wants as a society.

← PreviousPage 2 of 3Next →