21 karma · joined December 10, 2018
Terry even says this: "In fact, it is now the identification of a promising problem which is the scarce and precious resource."
The creativity and insight needed to ask a question that Terry gets excited about is the next step. Perhaps OpenAI should create a set of challenging questions and offer a prize to solve them.
But as I say this, I realise the tree species seem to change very dynamically from season to season. So I'll have to assume either the temporal rate of change is actually a lot slower than one would expect in a model like this (allowing large tree species to regenerate annually), or there are new coniferous flowering tree varieties in this universe.
What comes after vibe coding? At some point the AI will be asking humans if its new software saves us time and whether we'd pay money for it. Until then, there'll be some level of humans-asking-AI to solve a problem, probably with coarser and less detailed spec at each step.
You can only post-train so much... Try telling a child that martial arts isn't the solution to everything right after they've watched karate kid. A weak analogy, but it seems very clear that the healthy psychological development of frontier models is something necessary to solve.
Some good insights could come from those working at the coalface of child-psychology.
Wonder what the potential microbial turnover of lawn is? Multiply that by the average walk length and I bet that could handle one or two nuggets per day, even in a city.
That’s a side hustle idea for any disengaged strava engineers. Leave me an acknowledgement on the ‘about’ page.
I'm arguing that it's your own bias generated from the synthesis of your own idea that selects for sentences that effectively express the idea, and nothing to do with the writing itself.
The anecdote about the puddle who suddenly gains consciousness and remarks that the world is so perfectly formed around it, that it's proof of divine creation, seems to apply here.
The author generates an idea and is trying to articulate it. A well written sentence or paragraph that flows, pleases the author. This is because the idea they are trying to express is done in a satisfying way.
Thus the more pleasing the writing to the author, the more efficiently it articulates the original idea. It's the author's bias, based on their own idea, that defines the level of 'pleasingness'.
Lastly, Paul, do you think the LLMs are any less satisfied with their confident and irrational hallucinations, than they are with their more well supported claims? Further, if you weren't aware that the output was ridiculous, would you be able to tell a accurate statement from a false one?
Thanks for the essays. Love them.