793 karma · joined May 9, 2018
In that way, he truly is like any other artist (so engaged.) At the same time, rest assured we can celebrate and enjoy the extraordinary achievements made in that paradigm.
Meanwhile Meta’s competitors commoditise and glean profits from actually-SOTA LLM offerings.
In any case, their hypothesis is testable: which open source innovations from Llama1/2 informed Llama3?
With that framing, they never stopped composing like Bach
"When we set up DeepMind, I took inspiration for our research culture from many innovative organizations, including Bell Labs and the Apollo program, but also creative cultures like Pixar."
https://www.theatlantic.com/sponsored/google-2023/unlocking-...
As for materials science, there's signs of life in graph nets https://deepmind.google/discover/blog/millions-of-new-materi.... Meanwhile maybe AlphaFold indicates a precedent towards deep learning systems that advance chemistry. I don't claim these are revolutions, but extrapolating into the future, they might be seen as the catalysts. Maybe.
I’m going to strawman a bit here, this might not be your issue, but I think it’s useful because this is a common pathology. The tool isn’t the problem. The problem is the underlying FOMO. You can’t read everything. You’re not going to read everything even if you bookmark it in the perfect app.
What if, instead of bookmarking, you scheduled time in your calendar for reading it to the extent you felt you’d extracted optimal value from that resource? How many hours a week would you dedicate? How many pages would that imply?—and how does that compare with your bookmarking appetite?
Anyway the better thing was here all along, it’s just only recently even enabled by multimodal retrieval: screenshots
They all have their issues. Maybe the crux of it is chat. If your work is integrated into your chat — the day to day online social space — it’ll feel “integrated”
There’s a timeline where Theranos was acquired for 9b by UnitedHealth if they could keep the grift alive juuust a bit longer and Elizabeth Holmes ascends to the tech firmament permanently while her enablers congratulate each other.
Tesla has even more and deeper financial and branding defense mechanisms. That said, the clock is ticking, now, I think
They are one mechanism that fits in a broader working culture. If you’re working solo, it’s an extravagant exercise. If you’re in a huge team, it’ll enable leveraging more expertise across the team and act as documentation.
There are a few different failure modes.
* Valuing output not outcomes is classic misalignment. (writing 40 page docs for promo — this doesn’t work except for very junior folks who are proving the ability to string words together more than deep eng)
* As mentioned, it’s a bit much of solo teams. Other small teams can comfortably communicate through issues (Jira) plus breakout sessions to hash out ideas.
* Engineers also need to be onboarded to effective design doc writing. (note a top commenter frustrated that their first effort isn’t immediately met with adulation, a possible flag.)
Writing about code is hard. Usually this is an exercise celebrated on HN. If you’re in a team, beware if you find your work is always that which doesn’t need to be explained and deeply considered in a shareable doc.
The bigger the opportunity, the more general the audience, the juicier the B2B market, the greater the risk.
Time was when Jasper was valued more highly than OpenAI. Now it’s flagging and OpenAI is headed for 12 digits…
I hasten to restate that is my understanding of the premise, in the spirit of collectively untangling the causal chain here. This is incendiary stuff on HN!
There are outstanding systemic inequities at every level of American society. The threat these represent to our long term survival and prosperity are such that we are keen to at least acknowledge and mark our and our prospective collaborators’ efforts to improve the status quo.
Maybe you don’t accept that. Maybe it’s asking for a virtue signal in service of performative posturing. Maybe this requirement had adverse effects (evidently it has.)
But there is a through-line of coherent logic, and the total failure here may be cause for alarm.
I share your frustration with the reticence of seasoned engineers to engage with these tools.
However, "structuring and executing large-scale changes in entire repositories" is not a capability that is routinely proven out, even with SOTA models in hellaciously wasteful agentic workflows. I only offer a modest moderation. They'll get there, some time between next week and 2030.
Consider: Some of the most effective engineers of today cut their teeth writing assembly, fighting through strange dialects of C or otherwise throwing themselves against what are now incontestibly obselete technologies but otherwise honed their engineering skills to a much higher degree than their comrades who glided in on Java's wing.
Observe that months of hand-sculpted assembly has turned into a single Python call. AI is yet another tier of abstraction.
Another lens is application -- AI for X domain, for X group, for X age, for X culture. Lots to do there.
Finally, there's empowerment. If this technology is so powerful, do you concede that power to others? Or are you going to be a part of the group that ensures it benefits all?
FYI, OpenAI published a labor market study suggesting professions that are more or less exposed to AI. Take a look.
“1. The sheer joy of making things.
2. The pleasure of making things that are useful to other people.
3. The fascination of fashioning complex puzzle-like objects of interlocking moving parts, and watching them work in subtle cycles, playing out the consequences of principles built in from the beginning.
4. The joy of always learning, which springs from the nonrepeating nature of the task.
5. The delight of working in such a tractable medium. The programmer, like the poet, works only slightly removed from pure thought-stuff. He builds his castles in the air, from air, creating by exertion of imagination.”
There’s real pleasure to building software, as long as you stay above drudgery, churn, and/or repetition
What’s your favourite music? Why?