632 karma · joined February 5, 2018
At least I'm not actively harming anybody and today in IT this is a huge privilege.
But gratz anyway
I would argue that this is the present, not the future.
> Well, maybe that's how it is - I suspect it's not like that, but I can't know for sure. My objection is that, whatever the plans of evil corporations and traitors-to-humanity scientists, our current technology is nowhere near enabling any of the "changes to society" the author fears.
You don't need advanced technology for that. The existing technology is more than enough and we're seeing the devastating effects on the existing society. I don't think that for the thesis of the author, the actual progress of technology is relevant: if it looks intelligent, they will apply the narrative and profit from it.
The author is talking about how the promise of a yet to come AGI helps to build a narrative today that is used to exploit people. This is one thing. The dystopia is a critique to the narrative itself, that would lead to even further deterioration of the social fabric if it keeps being pursued. This is completely independent by the satisfaction of the promise of AGI or similar. As long as the narrative is believable, it will be used.
Truth is never simple. Engineers have been "bullied" out of the debate (this is not really how I see it but ok) because they often hold beliefs that renders the debate impossible. The narrative of "engineer is a pure discipline" or that "tools have no political color" are still strong despite countless counter-evidence. In the case of software-engineers that are left alone in the hands of managers and their interests, the social devastation that follows is very evident just by looking at the news.
> So I think my position is the reverse of yours: if business leaders, activists, etc want to meaningfully impact the AI debate, they should engage with the engineers actually building it -- rather than having a debate among themselves.
This is a real and pressing concern for many of them but it's not easy. I'm an engineer and I'm trying to do just that, or at least bring the existing discourse to the engineers if I can't bring the engineers to the discourse. But believe me, the cultural and personal resistance is extremely strong, first of all because it forces them to re-evaluate the belief system and take responsability for what they are doing and what they did in the past. Staying in an ethical comfort zone where you can ignore the consequences of your action is much easier.
One very good argument I've read recently is that most of what pro-science people label as "anti-scientific" statements like anti-vax stuff are made by people that don't refuse science as a whole but just science coming from what they perceive is a corrupted establishment. Clearly this involve cherry-picking that validates their ideological positions, or it's just following the twisted narrative of some political group.
Science, with the capital S, is still society's reference framework for truth (and this is a huge problem, but not the one we are talking about) but these people refute the priests and the religion, not the God. New priests are bending the same God to their interests and the times favor them over the previous priests.
>is this how papers in non-STEM look like in general?
you're not familiar with. And yes, this is quite a good paper for sociology standards. It comes from a STEM-guy so I think I like his style of writing.
> the examples of claims (of AI proponents) are cherry-picked,
This is not hard science where you have to find hard rules and a counter-example breaks your argument. He's commenting on a trend that we can all relate to. Is it a vocal minority or it's actually the vast majority of the industry/media? For that you can go back to data but that's not the goal of the paper and it doesn't invalidate his thesis anyway, as long as the narrative dominates the public discourse.
The author is a system biologist writing about sociology, so the paper should be read with the vocabulary of sociology, not of colloquial language.
The debate sees corporations and the tech elite on one side and artists, activists and philosophers on the other, with journalists split between the two. Engineers are used by either side but they don't have their own voice and mostly because they don't have informed opinions or the cultural means and interest to join a non-technical debate as a cohesive force.
The result is that the whole debate is conducted mostly by people that has no idea how this stuff really works and cannot separate marketing mumbo jumbo from the actual practice of building "AI" systems.
It's therefore very refreshing to see the work of artists like Hito Steyerl or ssbkyh that actually learn how to work with Deep Learning or other techniques to actually create critique of the existing narrative.
It tracks the history of this narrative and explains who profits from it.
This phenomenon has a clear political and ideological root and both journalists, politicians and engineers should fight against it together.
If you want to explore more related topics there's plenty of related content in a reading list I've been developing in the last few months: https://github.com/chobeat/awesome-critical-tech-reading-lis...
Source: I'm a data engineer and almost every application I've seen in production made the world a worse place.
The manifesto is extremely naive and it's not a manifesto. A call to action with an ethical goal doesn't make sense without an ethical framework to decide what to implement and what not. Otherwise it's just implementation for the sake of implementation, nothing different than what is already done by random projects on GitHub.
Without epistemology there's no science. Period. Science needs philosophy because they have two complementing roles. If philosophy (or non-scientific thinking in general) doesn't define concepts, science has nothing to work with. Science's role is not to make up concepts. Sometimes a single person does that during scientific inquiry but he's stepping outside of science's responsability and ill-defined concepts created so many complications throughout science's history. Just think about psychiatry.
> and philosophy abandoned evidence-based inquiry.
Big citation needed.
> Perhaps one day we'll really understand intelligence and consciousness. Perhaps not. But if we do, I'm confident the answers will come from neuroscience, psychology, and/or AI, rather than philosophy.
That's not the point. For sure the scientific understanding of intelligence and consciousness will come from science. The role of philosophy is different: it's to define what's the intelligence your trying to make sense of, it's trying to frame the problem you want to solve with science, it's about pointing science towards the evidence you want to model and let it do its course because now the exchange is always been: "Go science, fetch there" and science replied "there's nothing there, but I've found neurons". "Oh nice, let's try there", "Still nothing, but I've found networks in the brain and processing in the visual cortex and the rest of the body", "Umh, weird. Maybe it's an emergent property". "Try there" and so on. Neuroscientists are heavily involved in philosophy in the first place because this back and forth is much more intense than in other fields and there's evidently something wrong in how the problem is framed.
> Neural networks can be expressed in fraction of that complexity
That's not an explanation. That's a rule to construct them. Same for evolution: one thing is to define a basic rule that underlies a phenomena, another thing is to explain why we like peanut butter and jelly using evolutionary psychology. The basic rule doesn't capture much. And sometimes, maybe, there's not even a basic rule to begin with, because we conflate a lot of stuff in concepts that have no root or relationships in the physical world.
https://books.google.it/books?id=r0Bf3lLys6AC&printsec=front...
https://books.google.it/books?id=OVGna4ZEpWwC&printsec=front...
These are just a couple of modern books with an anti-reductionist approach.
Then if you see emotions as a subset of rationality, then it's again your rational view of the world and how you make sense of it, but it's not the position held by most people.
Also your dunning-kruger is showing.
Simple answer to complex problems, outside science and engineering, are almost always wrong. The world is complex and naive answers are not sufficient, even if the subjectively make sense to you.
The guy is part of the establishment you're talking about: reason dominated the humankind for a few centuries and we are just now managing to converge to something better, while still being immersed in a reason-based society that is crumbling, leaving big voids filled by any kind of ideological scum because the post-reason is not here yet. But anyway, your conspiracy of philosophers against engineers has no root in reality and it's just fear of the complexity of the world.
Reason itself can understand its limits. That's a good thing, we are lucky and we got to that poitn.
> It's rather the opposite here; some are trying to forbid reason to stray outside the box they believe it belongs in.
Nobody is forbidding anything, as long as you don't make it dangerous. Excesses of reason led to great crimes in the last centuries but this is not the case.
> The possibility that reason might explain mental processes appears to be so threatening that many people are attacking this video for daring to try.
Reason can explain mental processes for sure: it's called neuroscience and it's a thriving field. But consciousness or intelligence are not only about mental processes. I mean, you can believe so but then we say your opinions are naive, because there's plenty of evidence that mechanicism is not enough to explain human experience. We are not attacking this video, we are criticizing it for making the same mistakes of so many reductionists before him. If the attacks seem vague is because probably you're missing the whole discourse going on in the last 20 years in the Philosophy of Mind and related fields.
Also reason is not sacred, get over it.
Also for example, mathematics and physics are usually fields that rarely have direct applications and most of the time they provide tools for other fields. What if the physics and maths we have now, or the way we frame the problems these fields should solve, are biased? What if this bias is preventing the creation of useful tools for other fields?
The problem is that we must acknowledge the impossibility to "think outside of the box" of reason. By doing so we open ourselves to a wider spectrum of possible discoveries and constructions, even within science and engineering. What exists might not be biased in itself, but the fact that we reached some results instead of others is dependant on cultural biases that exist outside the field itself and inside the individuals and organizations pursuing science and engineering.
Race, gender and class in this case are clearly connected because he embodies all the stereotypes of the white male STEMlord. It makes sense, he summarized readings from others like him to appeal to a crowd of people like him. The crowd is becoming aware of this echo-chamber/safe-space for engineer and questions his motives, because they have been fed the same ideas over and over and he doesn't challenge them but just reinforces them.