5,558 karma · joined July 8, 2014
Static analysis for example. Although I’ve heard that LLMs can now do that if a user wanted it.
But you can also have many engineers operating it, testing outputs like you would in a real factory, etc.
Will be interesting to see how this pattern evolves. If it even makes sense.
Anthropic is already doing this - some software engineers have redeployed into research roles, for example. “Redeploying” is going to be the latest HR trend I think.
It’s not unusual for someone to spend $5k in a week. 2 guys at my place just spend $150,000 over 3 months building out a factory.
We are aggressively exploring open weight models now.
That they are IPOing tells me that the massive amount of funding they need is no longer available privately and that this is their 1 opportunity to get the funds they think they need to get there.
Biggest risk is the growth stalls as everyone moves to open weight models. They certainly like telling stories.
Now that opportunity cost is much lower so experimentation is more practical than before.
Looking at our AI spend today vs 1 year ago we have massive changes. Anything that can bring this under control and potentially save millions a year is being explored.
We will probably end up with a combo of open weight models for most work and frontier models for key projects. For now. Who knows what the landscape looks like in 1 year.
This is what will cook frontier AI and probably prevent the investment scale to happen for AGI. Humans + good enough cheap AI is just more economic and unbelievably productive. Like why we fly on jet technology from the 1960s still with incremental improvements.
It’s why Anthropic is desperate for capital and trying to get to a scale where AGI appears. But I’m afraid they won’t get there in time and the money to build the bigger model will have dried up.
How will it pan out, no one really knows. The leading frontier labs are continuing to hire aggressively. But who knows for how long or for long or near-term goals.
I had a conversation with a guy that is a leading endodontist that trains many dentists in the area and he said a lot of the young guys are just not that good. And that the good ones really stand out. It's just difficult to find people that have the smarts, intuition, and physical talent to do the job well. Experience really helps in this field. And yes, there are dishonest dentists that do unneccesasry work so best off getting a second opinion for anything non-trivial if you don't trust your dentist.
AI greatly removes that differentiator. AI doesn’t care if it needs schemas or if there’s an idiomatic driver for Python or Node. Even schema changes aren’t an issue and most databases support complex data anyways.
Much of the code needs to be performant and the LLM knows this and grinds on it. Less and less human inspection is needed.
I think 90% of software can be written like this today.
You’re simply testing outputs. Make a spec but ultimately ungodly amounts of tests can be built quickly to ensure the program is outputting the right things.
Does that really matter? Those are things so that humans can better understand and extend a code base. That mattered when writing code was expensive and took time.
Now if it can pass all the tests it’s fine. If there’s an issue just have it rewrite things immediately. New bug? Generate a new test and rewrite code.
All, or many, of the old things that mattered just sort of don’t anymore.
Secondly, much of Western Europe (except Norway) needs to figure out how to bring energy costs way down. It’s so expensive compared to the USA and Canada and people take home significantly less money.
Especially when the real numbers of immigrants is much higher.
It takes time to train more doctors, to raise more cattle, and to build more homes. Way more than the rate of immigration over the last 30 years.
It makes rich families richer though. But it hasn’t been good for working people and the community culture the country once had.
I can assure you mass immigration is not good for the working class families of this country despite what an economist might say in aggregate. The reality is more people drives up the costs of food, shelter, medicine, and other resources that are not very elastic.
Don’t overthink it.
But sleep apnea is really bad for your heart and lungs and does damage to them over time.
Saying that I have a CPAP machine and love it.