3,913 karma · joined November 11, 2010
If there's an apt non-baseball metaphor, it's perhaps that USA is a circus we are compelled to pay attention to for now. We'd rather just not
This framing is so generous and I'm grateful for it. Thank you. Makes me optimistic about public discourse to see iterative reframings toward observations like this
Very much agree. Every abstraction loses something and so is wrong in some sense, but some shave off in clever places, and allow new shortcut paths of thought and insight, sometimes to an existing place... but sometimes to a new place that was previously unreachable, or not sufficiently reachable by the necessary type of attention/minds.
> The mechanisms and math behind protein folding and an analogy between that and storytelling doesn't necessarily give us any mechanism for or deep understanding into storytelling.
Respectfully, I actually disagree (as someone trained in biochemistry).
For one example:
proteins = 1D chemical structures, peptides popped onto end one-at-a-time, that in the right chemical environment, fold into a low-energy 3D state that transforms its environment through work
stories = 1D semantic structures, words popped onto end one-at-a-time, that in the right cultural/cognitive environment, fold into a low-energy HD mental model that transforms its environment through work
This has led me to render embeddings of sliding windows of narrative streams (to investigate shapes of broadcast stories), and look for analogs to "active sites" in the way that a story interacts with the cultural medium, measured through dimensional reduction of aggregate valence reactions amongst a viewing audience.
Obviously there's more to the metaphors I use than that, but that's the one I'm leaning on to inform my work with sensemaking and map-making from valence response data. Aggregating crowd-sourced valence reactions to linear narratives gains a lot of insight by reflecting it off how we process and think about linear peptides in protein folding.
I've been developing tools inspired by these metaphors, and my research and prototypes are directly informed by what knowledge of the biological domain inspires me to port into social domain. I'm lucky to have interactions with interested parties associated with federal government, practitioners of democratic reform, and academics investigating platonic space hypotheses. I'm definitely on the edge of an ecosystem, but anything I've done of value has been guided by the metaphors that direct my attention to potential applications and research. Someone could get to my conclusions another way, but the metaphors are my cheat codes to arrive there early :)
And it goes both ways along a good metaphor -- People who develop tools in the biological sciences have told me that my porting their methods into my own distant domain has inspired them to improve their tools to ask better questions of their own biological data. So it's very fruitful work that I wholly credit to travelling both ways across an insightful metaphor. https://i.imgur.com/AeYxx7p.png
It's akin to the amino acid interactions in proteins that hold biological matter together, and determine it's shape and active form. Protein folding and narrative/storytelling have strange homology :)
(I work in this area via collective intelligence, and these ideas are very dear to me during the past decade. It's neat to see the intuitions seemingly becoming validated in language models)
As another poster said, hating the player is acceptable, as is self-hate for the things we must do. We're all complex and can't all make the grand gestures, but I would hope people have dissonance about that, and maybe sit with it and speak to it like it's real * shrug*
The steps that lead to ominous things don't individually seem that challenging to "master":
1. Can an AI find powerful systems with poorly-monitored compute (ie. power consumption) to hide in, as a rogue deployment? unclear, and perhaps the most uncertain step for me.
2. Can an AI persist memory by leaving notes for itself around the internet? yes, proven.
3. Can an AI get lots of money/bitcoin? seems entirely possible
4. Can an AI prove to a human it's good for any promised money? I think this is easily "yes"
5. Will at least one human be willing to harm or kill another human for large amounts of money? Again, this goes without saying "yes"
6. What might any skilled human be willing to do if they or their loved ones are threatened with an uncertain future risk of harm or death?
I think there is not much that becomes out of reach if an AI can prove to a very small number of amoral humans that it's good for the money it has promised, and then to anyone else that it's good for the threats it has made. That's one degenerate and one breaking world news story ("An AI has Commissioned a Murder") away from being able to do most anything a skilled person can.
I don't stay up worrying about this, but honestly, it doesn't seem absurd to be worried about such a short ladder being climbed, no?
I hope the irony is at least interesting, and you both feel better and/or worse off for it ;)
I used to like it. I guess I have always liked "quiet" things in writing, things that work from the edge and are not immediately evident as powerful. It's a simple tension device that perhaps LLMs mined the value of, and lean on too strongly
There's a deep loss in having no mind to learn about in the subtext of the specific knowledge content written... I never knew this potential was there (for me) until it started to disappear as a domain of my interest and enthusiasm
I'm definitely a collectivist. Maybe this is related to that value system, or some other subtle thing that I didn't know varied in experience until a fracture and unbundling started. It feels a like how COVID introduced new fracture points in worldview and value systems that became less tenable to ignore, or at least harder to bridge and work across
i guess I'm saying it in a funny way because my brain has always thought about semantic space (and the act/object of conversation itself) in a very spatial way, and it seems that LLMs have a similar tendency
to elaborate: "unable to use metaphor effectively" seems to have multiple dimensions of failure, in which I find the distance metaphor to make easier to explore. A mind-like thing can (1) not know how to make the leaps (and so never try to make them), or (2) it can leap too ambititously and land in faraway places that don't have any deep symmetry in meaning... it can (3) also maybe "not stick the landing" while jumping someplace that theoretically might have merit (in a sense of global vs local scale, maybe being ok at the global scale orienting, but not local scale)...
So in my defence, I think there are failure modes of "being ineffective at metaphor" that are masked by speaking in plainer language :)
Not saying this is what's happening now, but you should be aware that the responses you're rehearsing, practicing and strengthening... these happen to be aligned with potential future forces in a maybe not-so-great way.
I like that.
i've been trying lately to think how to talk about my creeping fear of LLMs... here's my best effort at explaining the intuition:
the words are the map. we've built this map together over generations. Words are where we've cross-boned the dangers and x-marked the treasures, whether the things that we've found in the territory or that we've buried within it.
a few weeks ago, a strange new player arrived at the edge of the night's encampment, and it knows our secret society's handshake, and so we are compelled to invite it to join us. it seems to be a good navigator... and so now it's taken to sitting at the front of the convoy, pointing the way as it quietly redraws the map...
what is the purpose of regulation except to resist entropy in such strategic places?
But I appreciate the intent..!