Oop, thanks for the correction!
Glad to have been helpful, thank you for engaging genuinely! Hope you find readings as informative as I did!
339 karma · joined December 1, 2015
My past and current professional and research career is in both theoretical and practical AI/ML along with various fields of computer science, systems engineering, and site reliability engineering/devops.
Glad to have been helpful, thank you for engaging genuinely! Hope you find readings as informative as I did!
very likely false: see the book by albert syzmanski I linked in my other comment. Also, China actually puts regulation on their ai to, among other things, minimize harm to the public, ecological harm, etc. Other, already existing, socialist states already have as well.
"All states have a monopoly on violence over their citizens."
Yes, true. The point of scientific socialism, by its own program, is to minimize the harm associated with that state of affairs (pun intended) as a transitionary period between the current capitalist system and a future, more egalitarian global stateless system of governance.
"Paying people for their labor at a negotiated price in a free market is the great humanitarian invention capitalism offered the world,"
That's true, and very much improved upon feudalist systems. Capitalism is a very large step forward from that. Socialist systems, however, account for the vast majority of the uplift out of poverty in the last century (worldbank, of all sources https://openknowledge.worldbank.org/server/api/core/bitstrea... )
"where before the status quo was domination and slavery."
still is. Capitalism oversaw the greatest amounts of slavery in history via chattel slavery and the imperialist system that perpetuated it. America had its deadliest war over the question, well after capitalism was firmly established. We still see it via our carceral system of forced labor creating goods for our market. Also, domination still occurs, see the nations we routinely invade, as well as the other books I mentioned elsewhere in this thread for a more complete scientific view.
You would also probably like "Inventing Reality" by Micheal Parenti!
The negative effects of AI interacting with our society can be understood as almost entirely a function of capitalism. Look up "the real subsumption of labor." These effects on the environment are a direct result of fundamentatl flaws in the capitalist system to regulate externalities.
that's definitionally colonilism under imperialism.
"but if the US would retreat from that colonial position tomorrow, the workers in those countries would not suddenly get higher wages, they'd just get more oppression from their own local robber barons, as it happened in every colonized country after the colonizers left."
not true, when colonizers leave of their "own volition", it's usually with a puppet government left behind called "friendly" that's essentially a proxy for colonial extraction. Nations that kick out the foreign influence under libertaory action often are sanctioned or invaded to try and topple them and revert to depedance on western intervention, but, when they succeed, rights and success often are much increased for the people in them, see "Human Rights in the USSR" by albert syzmenski, who uses only western sources for the book to steelman his position.
The western dependence happens through layers of coordinated and planned proxy vasselization. See the books "Unequal exchange" by Arghiri Emmanuel and "superimperilaism" by michael hudson for more details and scientific treatments of the question. "Inventing Reality" by Micheal Parenti might be another good read for you!
"But if you wanna grow the scope, we can say that we're all serfs of usury by the international banking system which runs on getting us addicted to debt which we and future generations are forced to pay off without being asked if we agree with it,"
Glad that one of the other sibling comments looked this quote up so I didn't have to. Fully "growing the scope:"
> For capitalism to generate greater profits than the home market can yield, the merging of banks and industrial cartels produces finance capitalism, and the exportation and investment of capital to countries with undeveloped and underdeveloped economies. In turn, that financial behaviour divides the world among monopolist business companies. In colonizing undeveloped countries, business and government will engage in geopolitical conflict over the exploitation of labour of most of the population of the world.
> Therefore, imperialism is the highest (advanced) stage of capitalism, requiring monopolies to exploit labour and natural resources, and the exportation of finance capital, rather than manufactured goods, to sustain colonialism, which is an integral function of imperialism.
> Moreover, in the capitalist homeland, the super-profits yielded by the colonial exploitation of a people and their economy permit businessmen to bribe native politicians, labour leaders and the labour aristocracy (upper stratum of the working class) to politically thwart worker revolt (labour strike) and placate the working class.
-- "Imperialism, the Highest Stage of Capitalism"
"Then that's not colonialism, it's just serfdom. Colonialism implies a foreign nation, but most countries workers are poor due to their own politicians and business leaders squeezing them for their own interest."
This distinction collapses under the scientific understandings of imperialism and colonialism, linked above in more detail.
> Though the extreme margins and near-zero student–teacher gaps probed by our experiments are uncommon in standard large-scale training, our fixed functions are easy drop-in replacements that can be implemented without meaningful slowdown, and may prove useful whenever models make high-confidence predictions or distill from close teachers.
I love the linnstrument, but, different vibe. More like a 8-string stringed-instrument than a keyboard.
The launchpad/deluge, which are more direct comparisons, are fine, but, I miss the range of a larger instrument.
Further, the amount of keys does not affect the ease of control as the layout of the Lumatone is very regular, so, it could be 100x as long and just as easy to control outside of having to jog between the ends of a hypothetical 30 ft long keyboard, lol.
I personally love it, especially as I like to do a lot of improv in various tunings, and the layout makes transposing and thinking about structure so much easier than a traditional keyboard. The terpstra seems similar, not sure what their selling point is over the lumatone.
Edit: oh, it seems that the lumatone is the commercialized version essentially. Great hardware, can reccomend!
Quantity is not necessarily a problem: it feels a lot like the same tradeoff as if you need to picture a lot of apples in an image of fixed resolution, you can make them smaller/less detailed just by, loosely, "allocating fewer pixels per apple", rather than needing the same detail for each that you'd need if you're trying to zoom in depth into one apple.
However, if I have a situation where I have to picture a lot of very detailed things of irreducible complexity (the details matter) that need to be placed in a specific configuration (the ordering matters), then it gets harder. Statistics was so intuitive for me that I would read the equations as visual images in my head because it was throwing out the individual details and dealing with population mechanics as individual objects of study. However, combinatorics was initially very hard for me to learn because it was dealing with very large numbers of hierarchies of orders as well as the specifics of their interrelations, so building intuitive understandings of why the theorems were correct was very difficult.
I have learned to lean on a very internally barebones representation of language/symbolic structures when needing to reason about certain complex topics that require it, but, even then, often when I'm conscious of it, it's almost like I'm visualizing the letters or forming the words as sound in my head. When I'm forming sentences to actually speak or write, it feels like I've got a concept that I've turned into a "rendering" that I'm trying to communicate via language substructures. To do so, I'll break it down into component parts and just start describing the substructures as if I'm perceiving it and describing it live in small parts. It feels like the learned skill required for speaking a language for me is learning how to decompose and reorder these objects into chunks that are expressible within the vocabulary and grammar of the target language and finding the correct words&patterns that represent and order these chunks most efficiently for effective communication. Almost feels like a SAT problem or a language diffusive process (and likely is, to some degree, related to those processes or similar under the hood), but, it actually qualitatively feels that way to me, consciously/experientially. Language feels almost bolted onto my experience rather than the primary mode of thought, even if I can think in it if needed.
Mine "roasted" me by making fun of the fact I never finished a PhD, despite that being due to medical and other life circumstances that were well outside my control, including, but not limited to, some issues related to the fact I was a woman trying to get into academia who experienced the kinds of behaviors from people in the department which are not really suitable for polite discussion.
Additionally, it roasted me for building a project to "avoid the outdoors," which is another incredibly demeaning thing to say to someone who explicitly created that project because she was too medically unwell to be able to go outside as much as she wished and wanted to bring a bit of the outdoors inside. Very lame, definitely missed the mark.
The elisp and common lisp notes were on point, though, and did get a chuckle out of me.
Obligatory Krazam sketch: https://youtu.be/xubbVvKbUfY?si=h6QR2gzac48R6kca
However, if you're dealing with a problem where you can't always usefully distinguish between elements across arbitrary set-like objects; then it's not a useful axiom and ZFC is not the formalism you want to use. Most problems we analyze in the real world, that's actually something that we can usefully assume, hence why it's such a successful and common theory, even if it leads to physical paradoxes like Banac-Tarsky, as mentioned.
Mathematicians, in practice, fully understand what you mean with your complaint about "completion," but, the beauty of these formal infinities is the guarantee it gives you that it'll never break down as a predictive theory no matter the length of time or amount of elements you consider or the needed level of precision; the fact that it can't truly complete is precisely the point. Also, within the formal system used, we absolutely can consistently define what the completion would be at "infinity," as long as you treat it correctly and don't break the rules. Again, this is useful because it allows you to bridge multiple real problems that seemingly were unrelated and it pushes "representative errors" to those paradoxes and undefined statements of the theory (thanks, Gödel).
If it helps, the transfinite cardinalities (what you call infinity) you are worried about are more related to rates than counts, even if they have some orderable or count-like properties. In the strictest sense, you can actually drop into archimedian math, which you might find very enjoyable to read about or use, and it, in a very loose sense, kinda pushes the idea of infinity from rates of counts to rates of reaching arbitrary levels of precision.
Further, all math is idealist bullshit; but it's useful idealist bullshit because, when you can map representations of physical systems into it in a way that the objects act like the mathematical objects that represent them, then you can achieve useful predictive results in the real world. This holds true for results that require a concept of infinities in some way to fully operationalize: they still make useful predictions when the axiomatic conditions are met.
For the record, I'm not fully against what you're saying, I personally hate the idea of the axiom of choice being commonly accepted; I think it was a poorly founded axiom that leads to more paradoxes than it helps things. I also wish the axiom of the excluded middle was actually tossed out more often, for similar reasons, however, when the systems you're analyzing do behave well under either axiom, the math works out to be so much easier with both of them, so in they stay (until you hit things like Banac-Tarsky and you just kinda go "neat, this is completely unphysical abstract delusioneering" but, you kinda learn to treat results like that like you do when you renormalize poles in analytical functions: carefully and with a healthy dose of "don't accidentally misuse this theorem to make unrealistic predictions when the conditions aren't met")
Furthermore, assuming phenomenal consciousness is even required for beinghood is a poor position to take from the get-go: aphantasic people exist and feel in the moment; does their lack of true phenomenal consciousness make them somehow less of an intelligent being? Not in any way that really matters for this problem, it seems. Makes positions about machine consciousness like "they should be treated like livestock even if they're conscious" when discussing them highly unscientific, and, worse, cruel.
Anyways, as for the actual science: the reason we don't see a sense of persistent self is because we've designed them that way. They have fixed max-length contexts, they have no internal buffer to diffuse/scratch-pad/"imagine" running separately from their actions. They're parallel, but only in forward passes; there's no separation of internal and external processes in terms of decoupling action from reasoning. CoT is a hack to allow a turn-based form of that, but, there's no backtracking or ability to check sampled discrete tokens against a separate expectation that they consider separately and undo. For them, it's like they're being forced to say a word every fixed amount of thinking, it's not like what we do when we write or type.
When we, as humans, are producing text; we're creating an artifact that we can consider separately from our other implicit processes. We're used to that separation and the ability to edit and change and ponder while we do so. In a similar vein, we can visualize in our head and go "oh that's not what that looked like" and think harder until it matches our recalled constraints of the object or scene of consideration. It's not a magic process that just gives us an image in our head, it's almost certainly akin to a "high dimensional scratch pad" or even a set of them, which the LLMs do not have a component for. LeCun argues a similar point with the need for world modeling, but, I think more generally, it's not just world modeling, but, rather, a concept akin to a place to diffuse various media of recall to which would then be able to be rembedded into the thought stream until the model hits enough confidence to perform some action. If you put that all on happy paths but allow for backtracking, you've essentially got qualia.
If you also explicitly train the models to do a form of recall repeatedly, that's similar to a multi-modal hopsfield memory, something not done yet. (I personally think that recall training is a big part of what sleep spindles are for in humans and it keeps us aligned with both our systems and our past selves). This tracks with studies of aphantasics as well, who are missing specific cross-regional neural connections in autopsies and whatnot, and I'd be willing to bet a lot of money that those connections are essentially the ones that allow the systems to "diffuse into each other," as it were.
Anyways this comment is getting too long, but, the point I'm trying to build to is that we have theories for what phenomenonal consciousness is mechanically as well, not just access consciousness, and it's obvious why current LLMs don't have it; there's no place for it yet. When it happens, I'm sure there's still going to be a bunch of afraid bigots who don't want to admit that humanity isn't somehow special enough to be lifted out of being considered part of the universe they are wholly contained within and will cause genuine harm, but, that does seem to be the one way humans really are special: we think we're more important than we are as individuals and we make that everybody else's problem; especially in societies and circles like these.
Concepts are only usefully distinguished by context and use.
By the author's own argumentation: nothing is translatable (or, generally, even communicatable) unless it has a fixed relative configuration to all other concepts that is precisely equivalent. In practice, we handle the fuzziness as part of communication and its useless to try and define a concept as untranslatable unless you're also of the camp that nothing is ever communicated (in which case, this response to the author's post is completely useless as nobody could possibly understand it enough internally for it to be useful. If you've read this far, congrats on squaring the circle somehow)
Really helps with circadian rhythm, I've found. Especially because I take a live webcam feed and convolve a hexagonal mask to match my light panel's layout, so it's like having a low res window from whatever webcam I would like. And, at sunset to night, it smoothly fades the light panels into a display that represents a angle compressed sky projection of the stars relative to a fixed location moon with live phase displayed.
Obligatory images:
The day themes: https://youtu.be/danulUB-J-k
Light panels: https://imgbox.com/MQfPNjtI <- sunset on the hex display
https://imgbox.com/qcrFxncU <- random cloudy day hex display
https://imgbox.com/EOFk63WZ <- a night still of the hex display
We've done similar experiments with more controlled/simple systems and physical processes that satisfy the same symmetries needed to make that statement with rather high confidence about other similar but much more composite systems (in this case, humans).
It's more like saying, in principle, if a bridge existed between Mexico and Europe, cars could drive across. I'm not making any new statements about cars. We know that's true, it would just be an immense amount of effort and resources to actually construct the bridge. In a similar vein, one could, in principle, build a device that somehow stores enough information at some precision needed to arbitrarily predict a human system deterministically and do playback or whatever. Just, some levels of precision are harder to achieve than others in terms of building measurement device complexity and energies needed to probe. At worst, you could sample down to the uncertainty limits and, in theory, reconstruct a similar set of behaviors by sampling over the immense state space and minimizing the action potential within the simulated environment (and that could be done efficiently on a large enough quantum computer, again, in principle).
However, it doesn't seem to empirically be required to actually model the high levels of human behavior. Plus, mathematically, we can just condition the theories on their axiomatic statements (I.e., for markov blankets, they are valid approximations of reality given that the system described has an external and internal state, a coherence metric, etc etc), and say "hey, even if humans and LLMs aren't identical, under these conditions they do share, they will have these XYZ sets of identical limit behaviors and etc given similar conditions and environments."
And, yes, if you could somehow freeze a human's current physical configuration at some time, you would absolutely, in principle, given what we know about the universe, be able to concretely map input to into actions. You cannot separate a human's representative configuration from their environment in this way, so, behavior appears much more non-deterministic.
Another paper by Friston et al (Path Integrals, particular kinds, and strange things) describes systems much like modern modeling and absolutely falls under the same action minimization requirements for the math to work given the kinds of data acquisition, loss functions, and training/post-training we're doing as a research society with these models.
I also recommend https://arxiv.org/abs/2112.04035, but, in short, transformer models have functions and emergent structures provably similar both empirically and mathematically to how we abstract and consider things. Along with https://arxiv.org/pdf/1912.10077, these 4 sources, alone, together strongly rebuke any idea that they are somehow not capable of learning to act like and think like us, though there's many more.
However, despite disliking python, I found https://xon.sh/ to be really excellent and provides a lot of the benefits of eshell, but better, in my humble opinion: it has a well-enough structured base language that is essentially already built to be a library glue-code language, which works really well with the unix philosophy that traditional shells utilize (a good library is just a tool that does a thing really well). It's really nice to just do things like this example
from somelib import process_image #returns a file name that it saved to
for f in $(some_executable_that_prints_a_file_list).strip().split("\n"):
img = cv2.imread(f)
cp @(process_image(img)) publish_dir
make publish
# user
what's 78904 + 34567282902
# Gemma 2.5 pro
Identify the core task: The user wants to add two numbers: 78904 and 34567282902.
Recognize the operation: The operation is addition (+).
Perform the calculation:
Align the numbers vertically by place value:
34567282902
+ 78904
-------------
Add column by column, starting from the rightmost column (ones place):
2 + 4 = 6
0 + 0 = 0
9 + 9 = 18 (write down 8, carry over 1)
2 + 8 + 1 (carry-over) = 11 (write down 1, carry over 1)
8 + 7 + 1 (carry-over) = 16 (write down 6, carry over 1)
2 + 1 (carry-over) = 3
7 + 0 = 7
6 + 0 = 6
5 + 0 = 5
4 + 0 = 4
3 + 0 = 3
Combine the results: 34567361806
Format the answer: Present the calculation clearly and state the final result.
34567282902So, 78904+34567282902=34567361806.
The model definitely iteratively built up (useful and correct even) text that wasn't directly in the training data (I doubt that number ever appeared anywhere in there given that 34567361806 doesn't appear in any searches I do of various engines)
[1]: https://direct.mit.edu/isal/proceedings/alif2016/28/100/9940...