13,709 karma · joined March 30, 2021
Most big tech have a lot of stuff around SDLC that’s theirs and they couldn’t realistically release it given how specific its deployment, configuration and management is. The marginal benefit to generalizing it is so low that it’s negative.
This is almost certainly worse given the vibed out state of it.
This is total BS. No one is taking up smoking because cancer will be cured, because the reasons to not smoke are a lot more social than medical at this point. I suspect Palantir leadership is so used to lying that it’s become pathological and they can’t speak with it being laced with lies. Truly the worst of the worst, which for modern tech is a rarified honor.
In fact many large companies were already trying to downsize their footprint and adopting hotel seating and we work foot prints, encouraging work from home increasingly. The BYOD move saved a small amount compared to what was being discussed - BYOO - bring your own office. The pandemic led to a reflexive reversal in that trend due to irrational reasons, despite having already approved a decreased footprint pipeline.
I don’t think the hand wavy stuff will carry water post the next downturn. In 5 year planning many companies do for occupancy plans I can’t imagine “serendipitous water cooler moments” is going to be high on the cost cutting agenda.
To Ryan, I don’t think your frustration with the tech industry at the moment is lone. I don’t know of any one super happy right now, and I know too many people under / unemployed for long stretches. Even when you land something it’s just a miserable slog of political wrangling to erect enough body shields to protect yourself during layoffs. It’s not what it used to be.
Myself I bailed and started something with friends. We took no outside money and have a slow but growing client base that seems to value what we offer. It’s the first time in a long time I can actually do something worth while. I’ve considered teaching, or even finding a job at the library. I’m lucky enough to have been well employed for a long time now so it’s more about health insurance (thanks US health care work slave system!). But for the moment I’m enjoying building things and solving problems which is what I enjoyed anyways.
Inflation especially impacts people older in life, who tend to be people who are more likely to vote and contribute to campaigns.
Lowering prices is of course more noticeable because you receive a raise once every long period, but pay higher prices (or lower) constantly and it’s very visible.
There are a lot of discussions of socialization of health care and basic income approaches and sovereign wealth based on automation dividends similar to the Alaska trust.
I think the current spate of mean cruelty ala MAGA and a glorification of a mean and cruel past that was never a golden age is a death spasm of a deeply unpopular belief system. As the actual realities of the policies sink in 70% of the populace is revolted, which is a super majority. That’s more than enough to put a pin in the philosophy permanently. It is also greatly accelerating electrification, realization of the value of expertise in technocratic systems in current generations, etc. I think humans are socially adaptable animals at a cultural level, but for the individual the adaptation process can be awful. I hope it’s not, because it doesn’t have to be. We will see.
We don’t know where this technology advance will lead or settle, so it’s absurd to try to establish a working paradigm at this point. It’s like any system, the initial conditions can be extremely chaotic and impossible to model, but with time often a stable state emerges. But the stable state is impossible to identify from early initial states.
I know a lot of folks feel this, to torture other physics metaphors, sensation of jerk - acceleration of acceleration. It’s an unpleasant and dislocating sensation. A world that felt safe and stable suddenly isn’t, and not in a micro tragedy sense but in a global realignment sense. This happened to factory workers who had enjoyed generations of stable work, farmers more slowly and just as surely.
This is what the late stages of scarcity feels like. Labor of various types devalues rapidly. Our exchange of meal and health coupons for toil cracks, and people realize their labor wasn’t godly as great books told us, but simply needed for want of an alternative. The realization that our labors might not be valued any more, and that our sense of purpose is shaken, coupled with the fact we’ve tied bare survival to our toil in our labor, is mortally tightening. No wonder people are grieving publicly.
But maybe our purpose isn’t to toil? Maybe we’ve passed peak population, and as toil is less valuable, we need less people and that’s why population is declining. Maybe we don’t need to exchange food and health coupons for toil, maybe mathematicians don’t need to rationalize their value to pursue mathematics. Maybe they can pursue it because they can’t help but pursue it, and our ever improving automations can produce their meal and health coupons?
But it might require Dr Tao to take an AI generated cancer medicine some day.
Reality is amazing!!
Soon there will be a story like this about one of americas last journalists being buried in the cement foundation of a data center.
The primary constraint isn’t likely what’s possible to do, but that the kernel and weights are too variable right now and the patterns too poorly established to bake into hardware accelerators yet. Margin pressure is also not there yet.
I suspect as the marginal utility of the frontier improvement settles into diminishing returns (I suspect we are there already tbh) baking hardware models with ROM, working set, and kernel cores collocated will be the frontier space as the goal will become reducing capital spend to utility levels rather than research levels.
Once someone has a model that is sufficient for almost any practical use, making marginal inference cost effectively zero will be the competition frontier. I do shed a tear for all those lonely data centers as compute densities will almost certainly make most of them a terrible investment.
But such is the cycle
The only case it’s not is when you reuse the password or you are afraid the password would be leaked in some way. “Exposing your credentials to the model” doesn’t seem to be a real risk vector in itself. The risk is exposing the access to the model.
I find the password vault idea convenient and likely appropriate but it feels like a bit of theater. Better would be revocable access grants, and a lot of things can support federation through google and whatever. What needs to become a thing is federation to some AI agent federation authority. OpenAI, Anthropic, Google, some well GTM’ed startup could do this and it would be a boon.
Their leadership failing the people feels like a heavy burden to place on the average person, especially in a society where there is no meaningful democracy, but even then.
There appears to be no end to what’s happening three years on. October 7th was a horror of horrors, but to visit that on an entire people day after day for years upon years as revenge, when almost none of the people suffering participated or planned it? What’s the point?
I have always supported Israel, but these last few years have gone into a zone of inhumanity towards their fellow man that is shocking to the soul of any person with human compassion.
There appears to be no condition to end the suffering other than their death. That’s genocide. Evicting them from their homes by relocation, appropriation, settlement, destruction, is the definition of ethnic cleansing. These are disturbing things that we all agreed should never happen again after WWII. It disturbs me that Israel gets a free pass because of what happened to the Jews - the horror of the past doesn’t entitle anyone to visiting their own horrors.
Am I wrong? I’ve struggled with how to discuss this with my Israeli friends.