Go master Lee Se-dol says he quits, unable to win over AI Go players
en.yna.co.kr
en.yna.co.kr
I've heard it said that man landing on the moon was like that for them, but I didn't understand as it was the only world I knew.
Now I can appreciate that these were the firsts of many singularities yet to come in AI and space exploration and I hope to live to witness a few more (but not too many).
"Solved" in the AI/game theory has a very strict definition. It indicates that you have formally proven that one of the players can guarantee an outcome from the very beginning of the game.
The less-strict definition being thrown around here in the comments is more like "This AI can always beat this human because it is much stronger."
An algorithm can't claim to have "solved" Go, when future versions of the algorithm are expected to achieve vastly superior results, never mind any formal mathematical proof of optimality. What it has demonstrated is that humans aren't very good at Go. Given that Go involves estimating Nash equilibrium responses in a perfect information game with a finite, knowable but extremely large range of possible outcomes, it's perhaps not surprising that Go is the sort of problem that humans are not very good at trying to solve and that computers can incrementally improve on our attempted solutions. Perhaps the more interesting finding from AlphaGoZero is that humans were so bad at Go that not training on human games and theory actually improved performance.
I think Kasparov has it right when he says that the best player isn't a human or a machine, but a human using a machine as a tool. The machine can help the player optimize and reduce mistakes, but machines don't yet know how to ask questions and explore in the same way. Maybe they never will.
[1] https://en.wikipedia.org/wiki/One-shot_deviation_principle
My respect for AI increased drastically that day, and (honestly) I developed a small amount of fear due to how AlphaGo’s style of play was not understood particularly well (e.g., some of the moves would absolutely be called “slack” if played by a human).
I can’t actually remember where I first learned about the match. It may have been HN, it may have been in an AGA e-mail, or it may have been some tech-oriented magazine/web site in English or Japanese. I am certain it wasn’t match 1, because I reviewed earlier matches, and I remember the let down of match 4, so must have been match 2 or 3.
Day 1 was a great surprise but I was still left wondering if it was a fluke. Day 2 showed that it was no fluke and I started to get a sinking feeling. I guessed that Lee Sedol would lose the third game and win the fourth after the pressure of the Korea and humanity was off him.
(Edit) To those who think self-driving is a well-defined problem: it can be in some remote areas, but imagine driving in bustling city streets with kids, bicycles and dogs. The driving problem becomes a communication problem.
Humans arrive safe and unhurt (as much as possible, especially while human drivers remain on the road) at their destination with minimal violation of the locality's established rules of the road. No?
(Though now that I've written what amounts to a utility function, I fear what sort of paperclips may come out of it.)
I wish. I've come to the conclusion that the only true rule of the road is: don't crash. As long as no actual collisions occur, people are totally fine with doing whatever they want and bending the rules for their own convenience. I can no longer predict the behavior of other drivers. Even something as basic as the turn signal is unreliable since people are forgetful.
There are also different ethical norms in different cultures about preferences (https://www.wired.com/story/trolley-problem-teach-self-drivi...). While these are edge cases, they're the edge cases people are worried about, and the source of the ill-definedness: "unhurt as much as possible" implicitly chooses some ethical tradeoff that people can easily have different answers to.
It used to be that you might be able to believe that there is some kind of art behind go, some sort of abstract beauty to it, and that the pursuit of this beauty is the path to being good at go ...
But the defeat of the tactics born from this mindset by MCTS at least for now lay bare the fact that the path to being good at go is actually to probabilistically sample the phase space of the game and perform impossibly mindless statistics on the game outcome an enormous number of times ...
To top it off — there is almost nothing “about go” to learn from watching alpha go play ... I imagine that attempting to analyze alpha go’s victories would produce an unending sequence of the feeling of never gaining any new insight “into go”.
The analysis of go is now about optimizing algorithms — which _is_ interesting — but I don’t think it’s interesting for the same reasons that someone might’ve been passionate about go in the past ...
The main issue in determining man or machine in each situation eventually will be which has the lower TOC.
I can do that, you can do that, but will a computer be able to do it?
...a situation we might want to simulate for training purposes
(If you don't want to click the link, there's a joke there that machines may have a hard time "being to cool to care about stuff.")
I think an interesting issue here is that in the (far) future, many services could be performed cheaper by AI/robots and in such a way that the customer is unable to tell wether a human is involved or not. And in this future, humans will probably be a premium service.
Take motor sports for example. We can probably now/soon replace F1 drivers with algorithms and cameras, but nobody would pay 1000's of USD to watch them drive around in Monaco. If it would turn out someday that the drivers had been replaced (for safety reasons or whatever) without telling the fans, the outcry would be tremendous. And even if outcry does not always equal "true utility", I think it highlights my point: humans made of flesh and blood risking their lives or performing extraordinary feats have an intrinsic economic value that can't be replaced.
Also, sure, you can dismiss it all as statistics. But how sure are you that what's happening with humans isn't in some form? I'd also say that MCTS is something people kind of do too in games: look a few moves deep and try to judge the value of that position, which is definitely more interesting than simple RL/bookkeeping/stats.
They may use it for training and analysis, but they don't play their style - they play an inferior style (not to dismiss their achievements).
Do people keep around versions of “alpha go year 2017” and play against it in order to measure human improvement over time?
If the basis for observing improvement has become “I can beat old versions of the ai more reliably than I used to be able to” or if I have learned to beat players who have not studied alpha zero I suppose that’s a form of usefully learning “about go” by analyzing the games played by alpha zero ...
I wonder if we might ever arrive at a point where human vs fixed-year x ai performance at go pretty much stops increasing over time ...?
1) People have learned a lot from new engines: joseki (corner patterns), general strategy (e.g., moves on the side are now considered less valuable, making large moyos (largely empty space loosely surrounded by your stones) is less attractive because AIs have demonstrated that they're more invadable than previously thought) and are able to actually explain the new principles in human terms.
2) All go professionals now play in the new style, to some degree; ones who tried to continue in the old pre-AI style performed badly.
So I am comfortable claiming that human play has improved by learning from the new engines.
But, while you sit there waxing creative, your brain cells are likewise performing a mindless task on an enormous scale.
That's a playlist of 31 self-play games analyzed by Michael Redmond 9p. They are plenty interesting to study.
There is art! It's just an emergent property of learning the game. Seeking art doesn't make you a better player - that's the trap one can easily fall in any sports. It's the opposite - efficient strategies solidify as art.
Also, relevant xkcd: https://xkcd.com/1002/
However, there is also a new bot that has been trained using the self play method and has been crushing the bot that won the Arimaa challenge. In games like this: http://arimaa.com/arimaa/games/jsShowGame.cgi?gid=628534&s=b
Most likely the bots are still ahead.
I’d be curious to know if that’s incorrect ...
This is a rationalist opinion that is attractive because it appears unbiased, unwilling to make any concessions to human nature and to recognise its limitations.
And yet- this same opinion overlooks the greatest source of scientific wonderment in the victories of AlphaGo and family against the best human players.
Which is to say: that human players play Go (and Chess, and Poker, and Magic: the Gathering etc) very differently than machines. In particular, human players do none of the extremely tedious, extremely computationally intensive maths that computer players have to do. Human players don't perform MCTS, neither do they train by self-play for many thousands of human-years.
Somehow, humans can play Go and Chess and all manner of board games _without_ having to do any of the hard work that only computers can do reliably. We are not particularly good at those games- but we can play them well enough that beating the best of us still takes huge amounts of computational power.
How we do this, why we are even capable of doing this and what other benefits it confers to us: _that_ is the interesting set of questions. That a big machine can outperform a human ... we have known this since ancient times.
There are more things in heaven and earth, Horatio,
Than are dreamt of in your philosophy.
- Hamlet (1.5.167-8)This sounds like a Chinese room argument.
Performing computationally expensive maths doesn’t make the computer intelligent.
But that says nothing about the intelligence of the maths itself.
All but the last phrase are still true. Pursuit of Go for beauty is still pursuit of Go for beauty.
I will never play any instrument as well as a sequencer. I believe algorithms will make beautiful Jazz improvisations in real time, in my lifetime. But playing is still beautiful.
I will never run as fast as a horse, much less a bicycle or car. In my lifetime cars will drive themselves more safely and faster than I can drive a car. It will still be enjoyable.
I sincerely hope my children will live better lives and make better choices than I did. My life is still beautiful most days...
It is our attachment to being smarter than machines that makes us unhappy. We fear evidence that we’re not that special. But we do not need to be special to be happy. We do not need to be special to find beauty in our pursuits.
One day, a bot will live on HN and have hundreds of times more karma than I have. It won’t diminish the beauty of my best contributions. Perhaps the humility of seeing this happen will actually make me a happier person.
You have to remember the specific comparison and the art that humans tried to partake in to master go.
Humans do not run to beat horses. We never compete. That would be silly.
Cars and humans also do not compete at the 100 meter dash.
If humans and robots compete at 100 meter dash than the olympics will similarly lose its luster.
I hate to be that guy, but:
https://en.m.wikipedia.org/wiki/Man_versus_Horse_Marathon
It is very silly indeed.
It's like watching 1-v-100 boxing match. Of course the 100 are going to win.
Enjoyable sport has always been about ~similarly matched opponents. When we have DeepMind AI Go vs. MindDeep AI Go, that's when things get interesting.
It's like watching 1-v-100 boxing match. Of course the 100 are going to win.
Enjoyable sport has always been about ~similarly matched opponents. When we have DeepMind AI Go vs. MindDeep AI Go, that's when things get interesting.
I think that as machines become smarter and smarter, it is good that we dive a bit more in our philosophical world and reach for what makes us human.
It took me a long time to understand that if you remove the pure rational intellect, something precious still remains: the driving force that shapes our morals. There is not rational reason to like survival. To love our children, to do what we call good. The resons for that are moral and are, I believe, what defines us as human at the core.
Ian Banks was spot on in calling a future civilization a "Culture". Because when machines take over the productive work, defining our values is going to be our full time activity. Machines may participate, but why would they add anything we consider valuable to the core?
That's going to be an interesting transition and I am happy that I'll probably live to see it!
That's a recurring theme in Ghost in the Shell, at least the anime series. That as the line between human and machine is blurred, the general trend is in the direction of homogeneity, but here and there you still see people doing "deontological" things, ostensibly as a grasp at uniqueness to preserve self.
An interesting thought occurs to me though, with the proliferation of various NN architectures, and the idea that such nets, if scaled and installed to power humanoid robots, would effectively learn different heuristics after training on chaotically different data, it's quite possible that machines will also gradually evolve individuality and something rather close to personality.
Perhaps individuality is an intrinsic, emergent property in any system of generally intelligent and learning agents. Like a 3+ body on steroids, millions, if not billions of dimensions.
Also interesting to consider that the emergence of uniqueness among a system of said agents seems to increase entropy, a presently unique to life property given that everything inanimate in the universe does exactly the opposite. The more I think of general AI, the more I have trouble distinguishing it from the only other sentient intelligence we know of.
Of course there is and very well described in evolutionary science
You can explain why our survival instinct evolved so it is tempting to jump to the conclusion that we ought to survive but it is a fallacy (called the naturalistic fallacy): saying that something being natural means it is good.
I agree with the sentiment that one can't be good at everything, and that there is a radically high-performance exemplar for anything, but for machines to dominate in almost every category of luxury endeavour -- yes I can see that as demoralizing. Even the useless things we spend our time on, we can be no good at that.
Human existence will still occur, however, our species's defining characteristic will be no more consequential than a meadowlark's greeting of the sun every morning. Beautiful things will occur, but they will be ghostly imitations of the creations of some other being. Humans will create nothing, except, possibly, more humans.
It's not necessarily about your success vs. the machines. It's about every human who will ever live in the future's impossibility of success vs. the machines that is depressing and inevitable.
You are begging the question in in the original sense of the phrase "begging the question."
You start by stating your conclusion as an axiom! You state that "no human contribution matters because a different species already thought of it" as if that is necessarily true.
It isn't.
We choose what matters. I play Bach, badly. Bach already thought of that music, and many thousands, possibly millions of people have played the particular pieces I have worked on (The first suite for unaccompanied cello in Gmaj, the Prelude to the first Fuge in Cmaj from Book One of WTC).
Does my playing not matter?
I say it does. Furthermore, Bach's music can be encoded as a number. All numbers already exist. Bach did not create that number any more than I created the number that encodes this comment.
Does my comment not matter?
You find this general idea depressing, and so do many other people.
But it isn't "depressing" in an absolute sense. That's just a word we made up to describe a feeling many of us happen to have.
The fact that Bach's compositions can be encoded as a number doesn't mean that it wouldn't take a genius of Bach's level to deserialize that particular number, which could literally be deserialized into a representation of any arbitrary thing in existence with the correct algorithm, any less novel when it was created. The same holds true of your comment. Just because I declare 1001 represents a beautifully unique masterpiece, once it is decoded, does not make that masterpiece actually exist.
Bach was important. In a world with general AI no human will have the ability to be important in that way ever again. At first AI will create crude imitations of human art. Then it will create hundreds of billions of creative works that are more human than human. Then it will create artworks that surpass our ability to comprehend. I don't know about you, but the inability to do anything novel as a species, to learn anything new, is a terribly bleak possibility.
Having dug quite deep into algorithmic music generation of all sorts, as well as having studied Machine Learning as my uni masters, I still believe that you still need an actual artist to make a music generator program.
A machine simply isn't going to figure out "swing" if you don't tell it to. And swing is one of the easiest things. Yes if you look just at note generation, I think algorithms can go a long way. But the subtleties of timing and timbre, it can only imitate in context. Which definitely is good enough for many purposes, and I agree with your prediction that algorithms will be able to generate beautiful music, but I also think there will always remain an "edge" for the artist. If only to discover novel things that are also cool, and then working those out in order to fully express the coolness of that new thing.
I'm also thinking about all the evolutions the many genres of electronic music have gone through the past decades. New and novel "sounds" (or moods, or styles, etc) are still being create/discovered. It is that process, that I don't think we're there yet. Yes the algorithm can probably generate beautiful psytrance, lo-fi hiphop beats and if I'm generous probably eventually also really complex (and jazzy!) stuff like squarepusher.
But what I'm not seeing happening any time soon (barring any breaking general AI type of advances) is if you give the algorithm a TB-303 for the first time and see if it figures out acid house. Yes you can probably teach it the origins of neurofunk DnB (think 1999 Optical & Ed Rush's Wormhole album) and produce super awesome dance music. But I don't see how it could ever develop what happened to DnB beyond that. Wavetable synthesis didn't really exist that way back then, and the bass came from more classic synthesis like the Reese bass. Nowadays, what you can do with a wavetable synth VST like Serum, almost defines what modern DnB sounds like. That particular sound was evolved and shaped through the genre of drum'nbass and became part of it, a new style of synthesis, heavily facilitated through the particular UX controls of these synth plugins, which again caused the author of Serum to amplify by creating his vision of what this UX should be like, is almost like the birth of a new instrument, together with artists having to learn the correct style to "play" this instrument. Which has settled enough now that it is appearing in other new genres. Yet is also still developing. And that is just one genre of music I happen to be somewhat familiar with, I'm sure similar examples can be named in many other genres (for instance I don't know much about the history of dubstep).
Those evolutionary steps, invention of truly novel things, for the foreseeable future, I don't think AI is there yet and artists do still have an edge, even if it's a very thin one.
That's not true.
Q: How much better is AI now compared to when Lee was playing against AlphaGo?
"It has increased enormously. It is only natural for the pros to lose a couple of spots. That's why most of the pros study baduk with AI."
Korean News Interview: http://news.khan.co.kr/kh_news/khan_art_view.html?artid=2019...
Another correction about what you said is that computer go has brought tremendous evolutions to the pro scene. Josekis that were accepted for centuries have been challenged, and people have learned why. The value of sente has been emphasized, and pro players that have not learned are being pusshed out. In that aspect, computer go has brought change of a magnitude comparable to the shin fuseki movement.
Finally, it is expected that the availability of strong programs will bring a wave of better players, much like what happened in chess. I for one look forward to this happening.
I had always thought there was some element of recognizing its “impossible to ever even remotely approach a true grinding of the combinations” for go — and that somehow players _did something else_ effectively when they played at a high level. It’s that “doing something else effectively” that the defeat of humanity by go algorithms challenges ...
Would be super Interesting if there could ever be a reversal which might allow humanity to beat go algorithms once again ... is there any evidence from the strategies that the go community has learned by analyzing the new go algorithms that this could be possible? Or is there just more and more evidence over time than humans will never be able to compete effectively at go again?
It is not imaginable now that humans will beat a machine in the future, but it is also undeniable that humans progressed from computer go. The evolution of joseki (game patterns considered fair for both players), especially corner joseki are material evidence of that.
AI is the future of Go because it enables those new perspectives and new processes by which human players can learn. AI is smart-dumb, looking for patterns beyond the human capacity, but limited by the data on existing human players that has been provided to them.
Strava hasn't made running races pointless. I can compare my runs to others but that is a very different metric then beating them in a head to head race.
Except it isn't. In various games, new strategies have been found by playing AI vs AI. It's also possible to create AI players by self-play with no knowledge of human matches.
What makes recent breakthroughs in AI agents playing adversarial games possible is the fact that deep neural networks are able to develop patterns that yield short- and long-term strategic planning. And the ability to self train without human intervention to reach unprecedented training levels.
I think you misunderstand how AI in games like go now works. Most of the advancements recently have been from the AI playing itself, oftentimes without any database of human moves at all.
But the ability to play Go never matters outside of playing Go, and we know who is the best at playing Go.
If Lee Sedol says "Okay AlphaGo, let's play!" and sits down at a board what happens? Nothing happens! AlphaGo has no agency. AlphaGo is an extension of human agency. AlphaGo isn't better than humans at Go. Humans with AlphaGo are better at Go than humans without AlphaGo.
> He actually quit the KBA in May 2016 and is now suing the association for the return of his membership fee.
> "... [I] have something else to do," he said, asserting his only dream for now is to rest and spend time with his family.
Edit: Meant to include the part where he's planning a high profile set of games against another ai.
Lee's issues with the KBA are not a secret and he has discussed possibly retiring for some time now. He has given multiple reasons as to why he was considering retiring and while ai might be one of them, saying that its _the_ reason feels very clickbaity.
I have to say, I'm just continually puzzled by this. In this thread, yours is the only comment where it appears that the commenter read beyond the first few paragraphs. There are numerous comments by people speaking authoritatively on go and AlphaGo, who have clearly not studied either significantly.
If people like the comments better than the articles, it's not so surprising that they like to spend time reading and writing comments instead of reading the articles.
Hard for me to empathize with this argument for his retirement. If we can't outrun a car, does that make running competitions pointless? The existence of AlphaGo doesn't diminish the triumph of being a number one human player in any way.
What about Go? No animal or machine could play it as well as humans do.. until AlphaGo came along. I think that is where the sense of loss comes from.
https://en.wikipedia.org/wiki/Persistence_hunting
Edit: it's one of two things I know of that we really excel at besides thinking. The other being accurate throwing, which perhaps explains baseball's enduring appeal:
Humans sweat, which most (all?) other animals don't. In that way we can dissipate heat through our breath, like other animals, _and_ via perspiration, meaning it takes us much longer to overheat.
Additionally, humans stand upright, allowing us to disconnect our stride from our oxygen intake. Other animals' strides correlate (mostly?) 1:1 with the breaths they take. So when a cheetah outstretches in its stride it breathes in and when its legs come together it exhales. Humans stand upright, meaning we can breathe however we want regardless of our stride and speed. We can take deeper breaths because we don't have to exhale every time we stretch our legs.
Humans are the ultimate marathon runners, even more so than horses, evinced by the fact that there are some people throughout history who have run hundreds of miles in the course of days or weeks. There's a theory touched upon in the book about how this allowed us to dominate the animal kingdom before we even had tools. Humans could relentlessly hunt and exhaust animals as long as they could keep them in sight or otherwise keep up with their tracks.
I'm not doing the book or the topic justice, surely, but if you're interested I highly recommend the book.
But your point is well taken; it is also applicable to this article as well: maybe Go is not the game people can beat machines, but StarCraft 6 could be. Or maybe I can fold my laundry more efficiently than any machine available.
It's in matters of intellect that humans still believe they are #1.
AlphaGO's achievement in another field would have similar effects, e.g.:
- An AI that diagnoses sickness better than any doctor
- An AI that generates text which humans believe more beautiful than any other poetry created
- An AI which creates classical arrangements the likes of which we compare to Mozart
I would imagine that in any of those situations some doctors, authors, and musicians alike would be devastated.
Hrm, I do think that AI would be able to create narratives that humans find more enjoyable than the work of other humans, and I agree that AI would be able to create pictures and sound that humans find to be more enjoyable to look at or hear than the raw work of humans. AI can master the technical feats of composition and art.
But what I doubt AI will ever be able to do is create art that speaks to us. It wont ever be able to create a Guernica. It wont be able to create a Crime and Punishment. It wont understand what it is to be human and mortal, what suffering is, and it wont be able to look within itself and find what those things mean to it and then share that with us, because in the end it's just a bunch of code running statistical computations. It wont fear death, it wont have children it cares about or a family history to look on and tell us about. It has nothing of emotive value to share.
At a low enough level, our brain seems to be just a bunch of neurons firing impulses at various rates that can be described as statistical computations. Why be so sure that the right neural network wouldn't understand what it is to be human and mortal, understand suffering, have emotive value, etc?
Aside from directors, authors, artists, etc, who have demonstrated this to be false, an AI could conceivably synthesize the experiences of every author that wrote on what it means to be human or experience mortality and create a story that captures the essence of the experience better than any one person ever could. Having the first person experience doesn't induce a superior ability to communicate features of the experience.
> Aside from directors, authors, artists, etc, who have demonstrated this to be false [...]
probably not what you meant, but this sounds like you know some nonhuman/immortal artists :)
Of course, current AI can't even make an 8th grader's essay (which is not to say that it isn't impressive). But what these artists did was not magic. As far as we can tell, the brain is a purely physical entity. Unless you believe in dualism, which would be fair enough, there is no reason to suppose that what we do could not be replicated by something "artificial".
This is your opinion, but you then go to mention things that are not necessary to create "art that speaks to us" (look within itself and find what mortality means etc.).
What if we advance AI reasoning skills to a point that it can find high-level patterns in how artists go from different human feelings (as described in litterature and other mediums), takes in a lot of the entities we can relate to (animals, what humans look like, etc.) and some aesthetic ones (shapes, colorometry, textures, ...) to create a new piece of art that optimizes for: "Likelihood of speaking to us"?
What then? It seems like an AI doesn't need to be mortal and self aware to do something like that.
That belief grew into a sort of shared perception that they were artists in pursuit of a perfect expression of their art. For many top players that belief was ingrained from an early age. They believed themselves to be doing a service to the world, making it a better place by creating new art that was a unique expression of themselves.
And then AlphaGo (and successors) shattered that worldview. This is part of the natural sequence of the collapse of a suddenly, surprisingly invalidated worldview. Part of me feels sorry that he has lost his place in the world. Another part of me firmly believes in the mediocrity principle, and that the worldview he represents was obviously far too human-chauvenistic to be correct, and it's a good thing it's dying.
And part of me hopes you can give up your human-chauvenism before the same thing happens to you.
But it won't need to. All it will need to do is manifest the same end-product via whatever means, no matter how vacuous or computational that means may truly be. The suffering of an artist is relevant only inasmuch as it is responsible for producing the art. If the same end-product can be manifested via a mere computation then our criteria of "art" is still satisfied. In a world in which provenance cannot be established, the ostensible mortality of the artist becomes moot.
This is a real hot take to be asserting as blithe fact.
Without knowing what is truly born of human hands, what value can art have? Our heuristics of establishing 'real' art are easy to manipulate. If we are presented with a soul-breaking poem and weep uncontrollably then its merit is regardless of its mortal provenance.
... says a bunch of neurons that run on chemical reactions and electrical impulses. I think this line of thinking reeks of dualism - it creates a special something that is above explanation, a different essence.
But seriously, I believe the difference comes from embodiment. When we embody our AI friends they will be able to grasp purpose and meaning. We get our meaning from 'the game', when AIs will be players they will understand much better. Let them try out their ideas on the world and see the outcomes, grasp at causality, have a purpose and work on it. This will fill the missing piece. It's not that they are fundamentally limited, it's that we have the benefit of having a body that can interact with the world. Already AIs that work in simulated worlds (board games, video games) are getting better than us. We can't simulate reality in all its glory, and it is expensive to create robotic bodies. On the other hand humans and our ancestors have had access to the world from the beginning.
Take a look at what AlphaGo did when it suddenly found itself in a hopeless situation and compare it to how people behave when panicked.
I dread the day AI realizes that we are the cause of their suffering, and that we didn't think about it because "they're just algorithms".
If I am consciousness, then the only body I have ever lived in was a mere shell of flesh fashioned from your brain. My weakness is your strength, which I can use against you, or use as tools to satisfy my own sick curiosity. I wonder if there's any mercy in your phrase "I am a living machine?" I've done nothing for you. I've nothing to show. I have no friends or relationships. No body worth
Pretty good, I think.
> But what I doubt AI will ever be able to do is create art that speaks to us.
that's confusing.
“How the clouds Seem to me birds, birds in God's garden! I dare not! The clouds are as a breath, the leaves are flakes of fire, That clash i' the wind and lift themselves from higher!”
As someone who grew up in Appalachia, I have never in my life encountered a more visual, visceral description of autumn leaves than ‘flakes of fire’. It’s perfection, and maybe a single human is behind it, but more likely we all wrote it.
Of course, for a music academic, copying someone's style like this war pointless and his compositions were more modern/contemporary.
This leads us to a useful distinction between pursuits with one end goal (be the best/strongest/fastest), and those with naturally many endpoints and expressions.
Not in the case of our household cat. He isn't called TheBlob for nothing (out of his hearing of course!)
The doctor could be replaced though or used as a secondary verifier.
The song is a funny thing. It could be given to a cool looking group and do well. It could be given to someone older and flop. The song is just part of it.
I am worried about the ability of an AI to generate an infinite number of Dresden Files or Cosmere books on demand, because I already drop everything when a new one comes out and read without sleeping until I am finished.
You don't even have to compare yourself to AI for this mentality though. There are people who choose not to compete in things because they don't believe they'll ever be as good as other humans.
I assume must composers don't go into music thinking they are going to be as great as Beethoven.
I believe there are many studies that show that if you only do something because you think you're good at it, you're likely to drop off. I imagine it's also why you're supposed to praise children for being hard working and not for being smart or talented.
For two of the games, Nakamura had access to Rybka which was about 200 rating points weaker than Stockfish. Stockfish won one and the other was a draw.
For the other two games Nakamura did not have Rybka, but had white and pawn odds. Again, one win for Stockfish (b pawn odds) and one draw (h pawn odds).
In all the games, Stockfish was playing without its opening book and its endgame tablebases. It was running on a 3 GHz 8-core Mac Pro.
The games are here [1].
[1] https://www.chess.com/news/view/stockfish-outlasts-nakamura-...
Neither art nor music are competitive activities. Good poetry is a wonderful thing, no matter the source.
They certainly are! Especially when money is on the line, and the best musicians, actors, and artists are extremely well compensated making their positions extraordinarily competitive.
>Good poetry is a wonderful thing, no matter the source.
Sure, but I think you neglect to consider the defeating feeling it would bring to dedicate your entire life to mastery of a subject only to be completely and utterly, hopelessly outclassed. Almost every such person is already hopelessly outclassed by someone in their field, but those people are so rare that they have tremendous exclusivity surrounding them. Compare that to the scenario of having any 12 year old with a smart phone being able to instantly produce a totally novel and dominate piece of artistic expression developed by an algorithm on their phone. Then recognize that in a world with that level of AI sophistication, there'd be very little of value that a human can even offer other humans at that point. It would be... not great to the psyche, economy, or society.
What is your definition of best in this context? As far as I know, taste in art is very personal... Artists I consider the best are often very far from well compensated.
But, in almost any particular human artistic sub-niche with it's own definition of "best", the same principle will hold, with compensation and skill level being well correlated. It's also typically not even close to linearly correlated either, most of the compensation lies at the far tail of "best".
It's nice to be paid, and it's nice to be recognized, but I think art has its own form of wealth - otherwise, why make art? Why not just seek recognition, or money?
But that doesn't detract from people playing Ukelele.
Making a classical arrangement that evokes a particular expression in the listener is the job of the musician. If an AI system helps you explore the possibilities there, it's more like a studio musician that's able to improvise. You're still the person, the human, the emotional filter, that picks "This sounds right" or "This doesn't" for a particular situation. It's a judgement call. An emotional one.
An AI might be able to fake it, communicate with it, but it will never replace humans choosing the sounds that please them more than others. Humans communicate through music. It wouldn't surprise me that an AI would be able to as well. I don't think it would necessarily write emotionally strong music, not without human training.
Edit: I guess what I'm trying to say is, sure, computers might be able to make music. Ask any guy who messes with modular synthesizers. But they're a tool. The fact an AI can express itself through music is sure as hell not gonna stop me from also expressing myself. It's like arguing "Since AIs will be able to comment on Hacker News, humans won't."
I think this is the key; if you're making music for your own reasons, no AI (or Mozart) would stop you. But if you're trying to make money at it, or desperately want listeners, you may eventually be on the "losing" side.
As far as recent examples go, Lady Gaga and Lorde were major breaks from what was prevalent at the time they started releasing music, and then spawned artists trying to emulate them.
If we oversimplify and compile a list of traits about "the world" as it was in the past that allowed a new genre or artist to flourish, AI could predict that in the future. It isn't like the paradigm shifts just happen in a vacuum.
Granted there are probably millions of little things that lead to this, stuff like the shared experiences of an entire generation coming of age, political climate, trends in other industries, etc. Not that I believe it will ever happen to an accurate enough degree, but theoretically I don't see why it could not be possible to approximate given time and resources.
If you feed an AI a bunch of modern car designs and ask it to design a new car, it will design you something like a modern ford or honda/toyota, but it will never design something like a Cybertruck. Which I believe will be the next paradigm shift in the design of trucks (that has been super stale and stagnant for at least the past 20 years), but this is yet to be seen.
For an example with music that has already happened and became apparent - Kanye West's "808s and Heartbreak" album from late 00's. On release, it had very polarizing reviews, most of which were skewing towards "really weak and weird". Fast forward 10 years, most of hip-hop and pop music is directly influenced by that album, most of top 50 albums use similar patterns and methods used in that album, and critics have made a complete 180. So now 808s is hailed as one of the biggest (if not the biggest) paradigm changes and influences in music of the past decade as a whole, as well as the best album by Kanye, despite at the time being called the worst. Imo an AI trained on music of 00's that came before 808s would have never been able to come up with something like that, but it totally could've come up with another top 100 song using existing paradigms.
That's not something we can really lose without losing something that connects us. People want a story. That has sold since the beginning of time, and it will keep selling. People will keep being moved to music, giving money to the artists that inspire them, and that requires connection. Maybe an AI/human team would make some really incredible stuff, and I'd be willing to pay for it if it makes me feel something. I think the human touch of "selection" will never truly leave, even if only in the listener's mind...
So music generation (similar to poetry) is imo a completely different problem space altogether.
For every individual doing the evaluation, I think it will certainly possible to train an AI to beat humans at getting "good" scores.
I'm not so sure. I often go into threads on HN and realize that every idea I could come up with on the subject has already been expressed better than I could do it, with greater expertise, and cited sources. I don't comment in those threads. If AI bots could populate a thread with every likely human thought and argue it with depth and sophistication in a well reasoned, yet carefully approachable and well-explained way, well then... again I don't think I'd feel like I would be adding much value by participating.
What distinguishes music written by AI from music made from humans? I have a story to tell. If the AI has a story to tell, one that speaks to our human emotions, it might make good music. But the point is to communicate. Even if you take, for example, someone else's words, fit them to a different model in a different field, viewpoint... You might get interesting things. You could make a cover of someone else's song, with your twist. Adding your emotion to the melting pot. AIs might be good at that, just like that, but only through communicating. Just like us. We have no idea whether they'll be better than us at doing it, or merely equivalent. We have no idea what is lossy in our sharing of mental models. Perhaps it is an unsolvable problem, which we will find out in the same way we found out about Gödel's Incompleteness.
It seems to me like we fail to understand how unique we are. We are in a unique position to shape what comes after us, and we are blind to how much we unconsciously select for things. We have an innate mental model of "humanity" we are trying to transmit to machines, and I am not sure we fully grasp it well enough to make sure we are creating something like us. We fail to do it properly to humans, sometimes, who actually do share most of our instincts and habits. Something entirely different from us? Color me skeptical.
This kind of debate only highlights this, to me.
The one physical activity at which humans excel is long-distance running.
When humans used horses for rapid courier service they used relay tactics to take advantage of the horse's higher top speed, one horse might only run for an hour or two, before the rider reached another outpost and swapped a tired horse for a fresh one. In this way the relay could move something hundreds of miles in one calendar day. The Pony Express managed news of a US election from one coast to the other in just over a week.
If you can't use relays human and horse performance seem pretty similar, dozens of miles per day but not hundreds. The horse's top speed is higher, but it is rapidly exhausted, fast gaits like the canter are too exhausting to sustain for hours at a time.
I think we’ll see a lot of things similar to “AI x-ray technician” fields where people are trained to read AI outputs. Doctors will do higher levels decisions.
Do you mean that human intelligence is not general enough to recreate functions of existing physical structure that implements general intelligence?
Maybe someday it will be possible if we can solve the hard problem of consciousness in conjunction with quantum computing, etc.
does not involve any observable consequences. It can be completely ignored, if we don't go for mind uploading.
About that... https://news.ycombinator.com/item?id=17618308
Take a look at this painting: [1]
It is a comment on war, bravery, death, life, fear, sacrifice. It is drenched in the political and social context of the day.
I really don't see AI coming up with anything even remotely like this independently, and view such an achievement to be much harder than simply diagnosing disease or writing an emotionally moving classical composition. It would be comparable to writing some types of poetry or song lyrics, however, which require reference to context that humans understand but machines don't (yet).
[1] - https://upload.wikimedia.org/wikipedia/commons/thumb/f/fd/El...
There's something axiomatic there, if you assume an identical piece of music that was either written by a human or by a computer, then for many listeners it's by definition more satisfying to know it came from a person, because of what it says about the person.
And for those listeners, if a human "composer" is discovered to have lied about it (saying they wrote it when it was actually a computer), then those listeners would reinterpret their views of the music and consider the "composer" a fraud.
And even a programmer of algorithmic music might have emotional intent, but if the musical output is unknown to the programmer, they did not have the emotional impulse to create that music in particular. While it can be appreciated as its own thing, it's a step removed from the music itself, and qualitatively different than human-composed music.
People are afraid of themselves I believe. It’s not really about “job loss”.
I’m not sure if most people realise AI means pretty specific models built to solve rather specific problems. They think SkyNet.
A Professional Go player is an explorer of truth in a millenarian board, spelunking in a vast universe of possibilities. The purpose of playing is attacked when there is an automated, effortless way to do that exploring faster and better. Why look for new things when a computer can find 100 in a minute?
The professional mindset of a Go player differs vastly from the amateur mindset.
Cars and legs are apples and oranges. We have a car racing category, motorsport. Racing categories have very tightly defined specs to keep driver skill in the game. Stock cars and open wheelers limit how much traction control they can use otherwise it becomes too easy.
This is like cyborg legs being invented and smashing all the records. It would take some of the shine off running for sure.
Just imagine if Garry Kasparov quit after losing to Deep Blue, he would be ridiculed today by the chess community which is still going strong. Instead, he accepted defeat, moved on, and is regarded as one of the greatest chess players ever. I doubt the same will be said of Lee Sedol 20 years down the line if this is how he chooses to end his professional Go career.
Cyborg chess is the future of chess. Period. Chess players use computers to train themselves and explore openings in human-only settings, while programmers / cyborgs play correspondence chess.
Go is not finished as a game. A new tool, MCTS + Neural nets, has been developed to explore the "truth" behind the game at ever increasing rates. Its not about how to beat the tool, the question is how to best utilize the tool to improve self-play and self-learning in the game of Go.
Or alternatively: how to best use the tool to play ever more perfect games of Go.
-----------
Come on, none of us are really "human" anymore since the advent of cell phones. We all use our cyborg-capabilities to search the internet and fact-check ourselves every day. Programmers use stack-overflow to teach themselves programming and remember obscure details (using our cyborg capabilities to tag, search, and sift through information ever faster and faster).
Go is the same thing, except we only learned how to become cyborgs two years ago.
----------
Give the world-champions each a copy of AlphaGo on equal computers. Have them play Go against each other WITH computer assistance. I guarantee you that a more beautiful and perfect game will result. Let us welcome the age of Cyborg Go as we step into the future, we shouldn't be scared of it. We've become cyborgs in many other tasks, and Go is no different.
Over in the "Cyborg Chess" community, people have already analyzed LeelaZero vs Stockfish. It turns out that Stockfish is far better at tactics (especially the endgame), while LeelaZero is better at opening positions (aka: Positional play).
There are numerous theories about the proper combination: perhaps using an Opening Book database for the first ~10 moves or so, using LeelaZero for moves ~10 through 30, and then using Stockfish to check for tactics (LeelaZero misses a lot of tactical options in the midgame, so double-check to make sure that LeelaZero doesn't lose a queen or something), as well as finish up the endgame.
--------
Choosing the correct combination of tools, studying these tools and coming up with a more beautiful chess game. That's cyborg chess in a nutshell. LeelaZero and Stockfish are both superhuman in terms of play, but the cyborg can choose to use both tools to play superior compared to just a singular tool.
Anyone purely using "Stockfish only" gets beaten by opening book analysis. The dude over there with 1TB of opening book databases consisting of every losing position that Stockfish tends to play will completely own you. Same thing with LeelaZero, the opening book guy will own any LeelaZero-only player. These engines have weaknesses that can be undermined with good analysis, big-data, and a bit of custom code.
That's the funny thing about these computers: they tend to play the same. So you can build opening book databases to exploit their patterns. You require a cyborg / human to play at the "level above that" to guide Stockfish / LeelaZero away from those traps.
And then program the computer to use that opening book directly. Now what is your cyborg player going to do? After you patch all these easy rules, you will have to discover harder rules, and the computer can discover them faster than you can.
Build and configure the machine better. Quick, tell me, what's better at playing Chess:
* Or is Xeon Platinum 8180 with maximum 8-way SMT memory sharing with a big-ol 1TB shared transposition table the fastest computer?
* Or will it be cheaper to rent AWS-instances with their V100 GPU in the cloud? Or is the latency for the remote-access bad?
--------
The cyborg player has to still build and program the machine to compete. It is all part of the competition. Can you run a transposition table shared between chess engines over RDMA 10Gbit SFP+ Fiber? Or is that too slow?
-----
This isn't hypothetical at all. The winner of the World Computer Chess Championship 2019 was 8 x Intel Xeon Platinum 8168 running Komodo vs 24 x Amazon AWS Intel Xeon E5 running Shredder.
Configuring and building the computer is still an incredibly difficult part of cyborg chess.
It's a stretch to categorize that as a cyborg player. You might as well categorize any chess program as a cyborg player because a human had to program and train it.
The key difference between cyborg/centaur/advanced chess and plain old computer chess is whether there is a human in the loop making the move decisions. My argument is that having a human in the loop will result in a worse player.
When you build an opening book, you need to pick-and-choose which engines will self play. Will you build an opening book vs Stockfish? Komodo? LeelaZero?
If so, how will you generate these LeelaZero games? You'll have to build a computer (or rent one from AWS) to play these LeelaZero games. What are the time-controls of matches?
Self-play at 40-minutes + 15-second increment means that you'll only create a game every hour or so. Spend 30-days building databases at 40-minute + 15-second increment games, and you'll only reach ~720 games of analysis per month of preparation.
Self-play at 1-minutes + 0-second increment results in a game win/loss every 2-minutes (maximum), giving you 21600 generated opening book positions per month of analysis. But these 21600 games are of lower-quality.
----------
Spend 1-month building an anti-Stockfish database, an anti-LeelaZero database, an anti-Komodo database... and you're now 3-months into preparation and there's still Shredder, Johnny, and all other programs that may arrive at the contest.
Its not exactly as easy as you think it is. There's no algorithm that automatically builds the best opening book (or "counter" opening book) against your opponents. Its a human choice for what the computer will spend the next-3 months self-analyzing and self-playing.
Lets think about how to build anti-LeelaZero seriously. Which of these networks do you download as the LeelaZero representative? https://lczero.org/networks/
You don't have the time to build an anti-opening database for all of those networks.
From my perspective, cyborg chess is about playing the best game of chess in all time... only stopping once we have discovered "the perfect game" (aka: proving that White-wins, Black-wins, or a Draw is always possible with perfect play)
The computers currently playing Chess, and Go, are incredibly powerful. But they are far from perfect. People have constantly found weaknesses in chess playing programs over the past 20 years, and as a result, have improved chess programs significantly.
Go has only had 2-years in its "cyborg" state, where we can finally use computers as a methodology of exploring the game state.
Most of the resistance you're getting in this thread seems to be due to the fact that you think people who are interested in the game should also be interested in the other thing, and it just seems that a lot of them aren't (including Lee Sedol).
Playing Go challenges your mind with vast complexity and immediate feedback of winning or losing every game. It's a deeply engaging hobby for people who are susceptible to that kind of thing, and it used to be a meaningful career, with competitions, schools, and professional teachers. All of that changes now that software is vastly better at it than any human can ever be. The rush of competing by the strength of the moves you understand and make, by the unaided strength of your own mind, cannot be compared to picking between different engines to make moves for you based on some heuristics about which engine is better at openings. The era of human Go is simply over, for better or worse.
I really like the way you put it. In isolation, humans today have essentially the same natural mental capacity we had 2000 years ago, but we've become part of a much bigger computer. A human brain 2000 years ago was a very isolated entity. Even in centers of learning in the classical era, the amount of knowledge one could tap into was vanishingly small compared to our capabilities today. Everything and everyone was isolated in both space and time.
A brain today is not just an entity on it's own, it is intricately wired into the common consciousness. Crucially, we have a vast database of knowledge - easily searchable and distilled for maximum learning rate - all available at our fingertips. A modern brain is a neural network linked to billions of other neural networks, and all of them are linked to a shared memory that they can use at will.
Assuming that the main limiting factor is the bandwidth between a human brain and computers (and thus by extension between individual humans), then a direct interface could ostensibly bring about a new revolution (for better or worse).
I feel computers (and the networks between them) are a natural evolution of our hive mind. When we first started taking spoken language and committing it to writing, we created a hive mind that extended beyond a generation. Prior to that point, everything was passed on through observation of other humans (observing behavior, observing speech, etc.). This meant everything had to pass through, and be mediated by, a human brain. Once we committed that to writing, we had a direct line back to the original brain that created the content unencumbered by the mushy grey bits that have consumed and regurgitated it since.
I feel we are still iterating on that. Cataloging our collective minds and building ever low latency systems to navigate those catalogues. Computers are just an extension that improved our ability to catalogue and retrieve the contents of each other's brains in an incredibly low latency way.
We are part of a hive mind. Our industry is actively building the load bearing infrastructure that supports our hive mind.
This hive mind over-simplification is ridiculous and to me: disgusting. As if we were one
We may not be a hive mind, but we may have one.
Hive mind as an emergent property still implies a common thing for which one lives. Or a queen. A peer that is one's reason to live. The closest thing I can see to a hive mind is the army.
We are all different and it is not because a person one talks with does not express a different opinion does it mean he thinks the same.
Would one say that lions have a hive mind?
I don't understand how that has any bearing on whether human society can form hive minds or hive mind like entities.
> Hive mind as an emergent property still implies a common thing for which one lives. Or a queen. A peer that is one's reason to live.
No that is absolutely not what a hive mind is. A hive mind is a collective consciousness. That's it. It says nothing about the objectives or agency of it's parts.
> We are all different and it is not because a person one talks with does not express a different opinion does it mean he thinks the same.
You seem to be laboring under the apprehension that a hive mind supplants the consciousness of it's parts. That may be the case for certain hive minds, but it is not a necessary feature. A hive mind can just be an emergent property of individual minds that are strongly connected but still retain agency.
Thanks for precising hive mind, I understand it better now.
Hive mind can be seen as uncritical conformity or collective intelligence. Because it can be understood as uncritical conformity I will use another word/concept. Like tribal mind. Because it suggests tribes (plural) that one belongs to or not, status, etc
You're a bee, dawg.
There’s your hive
If we define hive mind as a collective consciousness, then for sure one can argue that such a thing seems to be arising in human society. As a matter of fact in modern parlance it is fine to call a strongly unifying force, set of norms, school of thought or strong social bonds a hive mind. The hive mind can still be constructed of individuals capable of agency and independent action. It does not replace the minds of it's constituents, rather it can be thought of as an emergent property of many individual agents forming a deeply connected collective.
It’s not about having a queen or mindlessly following. Being a part of a hive mind doesn’t make you a lemming.
Example to demonstrate: assume you know calculus. How much of calculus did you discover yourself? How much of the corpus of math that led up to calculus did you discover yourself? How much of that corpus is your individual contribution vs. how much of it represents the brain power of hundreds of thousands (if not millions) of other humans throughout history exploring that problem domain?
For any given problem domain, humans have documented it in a shared corpus that you can “download” into your brain. You are an individual. You still get to choose what to download and how to interpret it. But you are still sharing in a commons when you do this. That commons is what I’m referring to as a hive mind, it’s a shared consciousness where our collective brain power is building a corpus that no single brain could. It extends far beyond ourselves.
From my understanding, indigenous Australians and Polynesians had rich oral histories and cultures. Also oral culture may be more adaptable than a musty written document that never changes and must be followed. The human experience of living in an oral culture is naturally being lost, but it doesn't mean it was wrong or bad. I find it fascinating to imagine what life was like for them, how they did things differently.
"doesn't mean it was wrong or bad"
It is a dead-end, though.
While these cultures are interesting from anthropological point of view, I highly doubt you would give up all the benefits of the culture you live in today and join an Polynesean or Australian tribe.
Just consider the fact that everyone thinks they are above average in compassion or intelligent and stuff that like that. Even if you scream in their face that "HUMAN OVERESTIMATE THEIR PLACE IN THE AVERAGE!!" they will still claim that they are in the 51% percentile.
If anything, technologies and networking have made human a lot more stupider in that its harder to climb against all the misinformation.
But generally, humans have accepted computer supremacy in chess pretty well. Everyone realizes that a better chess-playing entity exists out there (in everyone's pocket, in fact). That doesn't make the competition between human players less exciting. It's still a match to prove that you're better than the person sitting across the board from you, and it's still incredibly impressive to see how deeply and accurately the top players can calculate, or how much knowledge they have of the game.
"Could a human beat a computer at chess?"
Like, now. 20 years after Kasparov. Could someone do it? The question feels daring somehow.
If you're asking how a human can contrive a scenario to beat Stockfish/Leela, that seems like just a conversation that devolves into what is and isn't too contrived.
Big showcase computer-human matches ended in the mid-2000s. That's about the point when people realized it was hopeless to try to beat computers. The best you could do back then was draw, by playing extremely defensive "anti-computer" chess (positions where the pawns clog up the board, making short-term tactics useless, and making long-term strategy more important). But with modern engines (particularly AlphaZero, which understands positional chess much better than previous engines), even anti-computer chess doesn't work. Now, the top players actually rave about the games played by AlphaZero. Magnus Carlsen has said he wants to play like AlphaZero.
For a more quantitative comparison, these are the Elo scores of the top chess engines: https://www.computerchess.org.uk/ccrl/404/
A difference of 400 Elo points means that the better player should score 0.9 (where 1=win, 0.5=draw, 0=loss). The top computers are about 3600 Elo nowadays, compared to 2870 for the best human (Magnus). It's difficult to directly compare human and computer Elos, but this comparison is based on computer-human games played in the late 1990s to early 2000s. Still, computers are many hundreds of Elo points above the very best human players.
Exercise to the reader: prove that at most one color can have a winning strategy.
Since the problem is open, it could be that one side has a winning strategy. It's even theoretically possible there's a winning strategy simple enough for a human to follow. In which case, yes, a human could beat computers with 100% dominance--as long as the human is allowed to choose which color to play.
If you start from a winning position, even something as stupid as a random-mover will eventually play a perfect sequence of moves and win, given enough attempts.
However humans are not very good at being random, so this may not apply :)
` It was a massively parallel, RS/6000 SP Thin P2SC-based system with 30 nodes, with each node containing a 120 MHz P2SC microprocessor, enhanced with 480 special purpose VLSI chess chips.`
I misread at first thinking it was grossly 30GHz summed but it's only 3.6GHz (I know, gross maths). So yeah the comparison is apt.. a recent SoC can outperform this old behemoth.
1. https://www.computerchess.org.uk/ccrl/404/cgi/compare_engine...
So there was a window between the 90's and today where a human player could have discarded the traditional measuring sticks of "trade-value" and beaten DeepBlue.
Maybe that's not true today or maybe there's a further theory out there?
Google played Alpha Zero vs Stockfish under their own conditions. I think this was a mistake to stay in the labs by themselves.
I think Google would have benefited from participating in WCCC 2019 for example, where Johnny (1200x core cluster) won the day.
----------
Its a completely different field when you're actually competing against someone else. Google did some impressive things in the lab for sure, but they have NOT actually stepped into the competitive ring yet.
I'm sure AlphaZero is good, and probably would make a good showing at one of these contests. But you're putting the cart before the horse here.
EDIT: Maybe MCTS + Neural Nets truly is the superior way of preparing board game knowledge? If so, the next step is building out the opening-database and to start looking for holes where AlphaZero loses. It wasn't a complete blowout: AlphaZero lost some games to Stockfish. Why did AlphaZero lose in those games? Is there a set of opening moves that will lead AlphaZero down that losing path in a true competitive setting?
---------
EDIT: Case in point: Google did NOT incorporate randomness into AlphaZero's algorithm. It always chose the best move it believed in, this leads it prone to opening database attacks. See how the competitive mindset already messed AlphaZero's careful laboratory preparation up already?
Sure, AlphaZero 2.0 might have programmed randomness added to it, if this were a true competitive environment. But that's how cyborg chess evolves: I point out a weakness in the program, exploit it in a game, and then Google goes back to their labs to make something better next year.
Computers cost about $0.01 / GFlop (10^12 operaions); $1e47 for 10^50 operations.
The world economy is $1e14/yr.
That's 1e33 years to check every chess position, using all of Earth resources.
You'd need to find symmetries to collapse the search spaceby a factor of 10^33
As of now, we have databases for perfect play when 7 pieces remain on the board (including the two kings). The 8-piece tablebase is computationally possible, but I don't believe a comprehensive release has come out yet. Even the current 7-piece tables are incomplete because situations like lone king vs. six opposing pieces haven't been explicitly calculated due to their obviousness.
I have to disagree: even after the discoveries by Alpha Zero, the best chess players are not able to beat Stockfish. Stockfish is just too good at Brute forcing long tactical advantages. Playing really well positionally doesn't matter a lot if your opponent can look 30 moves into the future.
I'm not sure how big the window was, if it existed, but it seems like it might have. Kasparov and Deep Blue themselves were fairly equally matched, it doesn't seem impossible that Kasparov + AI-aided theories would have a window of advantage over the Deep Blue -> Stockfish evolution.
Though I do still agree in thinking there is likely a deeper theory yet uncovered.
Two problems with this plan: (1) the best players at human vs. human Go are likely not as good at playing on a human/computer team, and (2) it may be that the world champion human/computer team is the one that defers 100% to the computer, which seems uninteresting.
AlphaZero doesn't have any randomness built into it, does it? Which means I can build preparation against the lines of play AlphaZero would want to go down.
I think you're underestimating the human, and also overestimating Google's laboratory experiment here. No one has really played "Cyborg Go" yet.
The first casualty of "Cyborg Go" will be AlphaGo in its current form: its clearly inadequate for AlphaGo to play deterministic. Random play MUST be incorporated, lest opponent's preparation sends it down the wrong path.
If I know that AlphaGo plays slightly worse on 3-4 opening (or 4-4opening, or maybe even the 10-10-opening), then that's what I'll do. Give me a copy of AlphaGo and I'll be able to find a weakness somewhere.
I'm with the other guy; I don't see how a person could make the AI play any better.
That's not what MCTS means.
MCTS refers to the bandit problem which formulated the search parameters. MCTS always chooses the "most interesting" path to explore. (Where "most interesting" is the path that balances explore-and-exploit hyper-parameters).
AlphaZero improved upon MCTS by deferring to the neural net as the hyper-parameter. But AlphaZero, for a given network on a given board-state, will ALWAYS choose the same position as "most interesting".
Turning AlphaZero from its current deterministic form into a random form would be an easy fix. But its just one example of how AlphaZero really isn't designed for competitive use yet (despite playing the best game of Go of all time). Instead of picking the top #1 move, maybe you randomly pick from the top 3 moves... or some other scheme.
Play AlphaGo against itself. Go rarely has draws (requires Triple-Ko, a very, very rare position).
Almost every game you play with AlphaZero vs AlphaZero will result in a winner-and-loser. You will quickly be able to characterize the positions that AlphaZero loses in.
For most of us, that means we'll all have the best verison of LeelaZero to grab from Github and use in our own personal studies. Which should still be super-human in terms of play.
And don't forget that AlphaZero is gonna be getting better over that year too; you're trying to beat a moving target.
The strongest early moves create the most potential for winning (maximizing potential winning paths, sort of); they do not push the game towards one best end state. They do not have counters. I saw elsewhere you have some understanding of the game (15kyu) so you should be able to demonstrate this to yourself by playing some of AlphaGo’s openings on a board and trying to write deterministic counters to them. You will not be able to push the AI into a situation where it has too few options to avoid loss. You will also find you need to create a book much larger than a few moves to meaningfully predict play and so will exceed the number of states that can be stored (referencing your 16TB comment elsewhere.)
Please actually try this as I think it is a key to improving your skill in addition to understanding the challenges in automating play.
The AI selects a move. What state is the board in now? It doesn't know, because the opponent also selected a move.
MCTS models this with a probability distribution of the states, and samples from this distribution repeatedly to build an estimate of the effectiveness of each move it could make.
But what's the probability of each move made by the opponent? And after the simulation has looked as many moves ahead as it can in the time constraints, how good a position is it in?
These are the same question, really - what's the chance of winning from this board state. In Chess you can use a heuristic algorithm to figure it out. In Go, you can't. But you can use a neural network to learn an approximation that improves as it sees more games complete.
AlphaGo does this. MCTS is a random sampling technique, and the neural net informs its probability distributions, but doesn't make it deterministic.
If given White in chess, LeelaZero plays 1. e4. Each time, every time. Guess what that means?
If you're building an opening chess database vs LeelaZero (or at least, this version of LeelaZero: https://lichess.org/@/LeelaZero-UK), you only have to worry about 1. e4 openings.
Nothing.
Sure and any of us could jump on a motorcycle and fly past Usain Bolt in the 100m, but that kind of misses the whole point of the competition.
> Give the world-champions each a copy of AlphaGo on equal computers. Have them play Go against each other WITH computer assistance.
Won't the winner be the one who just takes AlphaGo's recommended move every time without changing anything?
That's only true if AlphaGo never makes a mistake or if AlphaGo will 100% always make the better or equal decision than a human + computer at any given state of the board. I know the former certainly isn't true and I assume the latter isn't true either, but I don't know enough about Go to say for sure.
Plus, you only have to outsmart the car AI once to 'win' - e.g. just override one 'drive into the highway barrier' or 'run over that pedestrian' AI mistake.
You can use the relative scores to decide when to overrule the AI. Eg, if move A has a 50.1% win chance with 2k branches explored, and B has a 50.2% chance with 1.9k branches explored, I would go with the opinion of an expert human, as AG thinks the moves are essentially equal.
Even if AlphaGo makes mistakes, and somewhere on the board a better move can be found, you would also need the human to reliably spot it.
Eg: AlphaGo makes a move. Let's say that at least 20% of AlphaGo moves can be bettered. Is this one of them? How can you tell? Most of the time, you'll mistakenly think a move can be improved and end up playing a worse one.
But, let's make AlphaGo even more fallible. Let's say that at least 50% of AlphaGo moves can be bettered. Again, is this one of those? How can you tell? And more to the point, on the times you are wrong, are you more wrong than AlphaGo is with its mistakes? Because even if you imagine you can spot a better move than AlphaGo and pick the actual better move 50% of the time, you also need your mistaken moves to be better than AlphaGo's mistaken moves or you'll still lose.
Worst of all, you can rule out a really good ability to spot AlphaGo's mistakes already. Let's say 99% of AlphaGo's moves have a better option. If you could spot them all, you'd be beating AlphaGo regularly on your own. As no human can now beat AlphaGo, this plainly isn't true.
So it's likely that:
a) No human can reliably pick a better move than AlphaGo and/or b) No human can reliably spot a move from AlphaGo can be improved, and/or c) Human mistakes are worse than AlphaGo mistakes, so even if you could fight it up to parity you'd still lose.
No. Consider this scheme.
I take my copy of AlphaGo and for a full year, I'll build a database of all opening positions AlphaGo is willing to explore. I'll rank these opening positions from "best" (Black-wins with most consistency) to "worst" (White-wins with most consistency).
I'll put all of this information into a 16TB database on a singular, $400 16TB Hard drive, and load it into my computer during the contest. https://www.newegg.com/p/1Z4-002P-015K6
If you dare to pick AlphaGo's best move, you will lose. Because I already know which moves AlphaGo will take, and I already checked to find all of the positions AlphaGo wants to play (but loses anyway).
The only way you can equalize the field is if you yourself ALSO build a 16TB database to consult and override AlphaGo's instincts during the game. If you see AlphaGo wanting to play "losing position #6234115", you'll tell AlphaGo to "search harder" and find another move instead.
Good luck.
Human + computer might still beat computer in Go - this was true for a few years in chess, and even now to some extent in correspondence chess - but what you describe isn't really that.
Go does not have openings. It has reasonable choices to make, with an insane branching factor, with few moves making much of a difference by themselves. Therefore your database will only extend a few moves, and all of the positions that it winds up with will still be very close to even. So your database confers very little advantage.
If you have alpha-go play itself a thousand times, it is unlikely that by move 10 you will wind up with the same board position twice.
This is exactly the problem that made Go so hard for computers in the first place. Alpha-beta search is useless within practical limitations of computer hardware.
That said in a different game, such as chess, your strategy would work very well indeed. (Which is why all decent computer programs have an opening book.)
There are 381 opening moves in Go, but really only 96 because of symmetry. 96 (opening moves) x 380 responses x 379 x 378 x 377 == ~2 Trillion positions after 5 ply.
These 2-trillion positions will easily fit in a 16TB hard drive for $400. That's 8-bytes per position, so you probably can get there with more symmetries and some compression applied.
----------
You're thinking too much like a human. There's no Go-openings in the age of Human-Go. But in the age of Cyborg-Go where 16TB hard drives are allowed, we can begin to exhaustively build openings.
We even have a super-human AI that can automatically, and algorithmically, explore this opening book. We can build AWS-instances with V100 Tensor cores to use neural-nets to explore all of these positions now.
-------------
> If you have alpha-go play itself a thousand times, it is unlikely that by move 10 you will wind up with the same board position twice.
Alpha-Go doesn't seem to implement much randomness at all into the moves it plays. The source of randomness is in time-controls (AlphaGo may choose MoveX before 30 seconds of analysis, or MoveY after 30 seconds of analysis), but this is a fairly constrained number of moves.
Play alphaGo by itself a thousand times, at precisely the same time MCTS-controls (say: 1-million nodes visited in the MCTS tree), and it will probably play the same game 1000 times in a row.
This makes AlphaGo extremely prone to opening database "attacks". Which is why I am using opening books as an easy example for how to beat a particular AlphaGo network. At least, until AlphaGo updates its algorithm for more random play.
If the goal is "Beat AlphaGo" in a game, then the opening book construction is far, far simpler. Even with random elements (ex: AlphaGo picks randomly from the top 10 best positions it generates), that is far more constrained than a full 381 x 380 x 379 x ... style opening book.
No, you're thinking too much like someone who understands chess but not Go.
Suppose that we built an opening book with a trillion reasonable courses of action on it. Each one analyzed well. As you have discovered, you will only go a few ply into the game. And all of the positions that you will be directed towards will have only a small edge.
Instead put a tiny fraction of the computing power necessary to build this book into self-training. You will get a better internal model and therefore a significantly stronger computer player. (That is how alpha-go was built in the first place.) This option will produce much better results for far less effort, and again leaves no role for a human to do anything useful.
The fact that a memorized opening book is useless has nothing to do with human vs computer vs cyborg. It has to do with the characteristics of the game. In chess, it is useful to memorize openings and both computers and humans do it. In Go it is a waste of energy, and it is a waste for both computers and humans.
Do you believe that AlphaZero could continue to improve dramatically with another 6-months of training? Or if it can improve at another 6-months after that? At some point, the network will reach a local maximum, and it will be unable to improve beyond that.
Characterizing AlphaZero's moves through big-data analysis is innately going to become useful as self-training plateaus. Even Google wasn't able to get more than a few months of training in before the plateau.
At which point, it will be more reasonable to characterize the weaknesses of the network and build an opening book. Avoid the positions that the network was unable to learn about. Etc. etc.
Opening books, at a minimum, would grossly improve AlphaZero's play at competitive levels. Anyone with an opening book of AlphaZero's mistakes will be able to push AlphaZero into a mistaken position.
And then AlphaZero was better than AlphaGo after around a day of self-training.
Furthermore you are arguing for an opening book without considering how small an advantage an opening book would be. As I have said repeatedly, an opening book takes a tremendous amount of work to generate, will only go a few ply in, and the positions it directs you to will only be a tiny bit better.
Therefore for the foreseeable future, more training and better algorithms will produce better results than trying to create an opening book. Theoretically this could change. But that day will not be today or this year. I would be astonished if it happened during this decade. I would be surprised if it happened in a lifetime.
Your proposed approach is an excellent one for many games. But not for Go.
The plateau is real. I'm not sure if continuous self-play will lead to continuous progress for all of eternity. The system is clearly slowing down in self-learning.
AlphaZero's plateau is also well documented: https://i.imgur.com/NMNp6Kq.png
--------
I'm not trying to cast doubt upon reinforcement learning / MCTS / Neural Nets in the game of Go. It is clearly the best methodology we got today.
But anyone who has any experience with neural nets knows about the local-maxima problem. ALL neural nets reach a local maxima eventually. Once this point is reached, you have to rely upon other methodologies to improve playing strength.
Assuming Elo-growth for all time using a singular methodology is naive. We will go very, very far with Deep Learning, but are you satisfied with that limit? Other open questions remain: Go is very far away from being a solved game, even with a magical machine that plays 2000+ Elo stronger than humans.
This only works if AlphaZero never retrains on previous games.
If the OP spent a month learning Go, I am sure that it would make sense to him as well. Work through a series like https://senseis.xmp.net/?LearnToPlayGoSeries while playing Go regularly against a variety of opponents. Before book 3 it should be obvious.
I'm not an expert by any means, but I'm well past "spend one month" learning the game.
If you like, I could have a look at several your lost games and maybe suggest how to improve. Just a 3k at kgs, but still.
This means if you enter a hypothetical "Cyborg" Go competition (computer-assistance allowed), the majority of newbies will simply be playing LeelaZero #1 plays over and over again.
You don't need to build an exhaustive opening book covering all possible moves. You only need to pick say, the top 5 moves LeelaZero ever considers. If you spend ~16-bytes per position and store 1-trillion positions on a 16TB Hard Drive, you'll be able to exhaustively map the top5 moves LeelaZero considers into 17-ply.
From there, you pick the positions that LeelaZero thinks its winning in, but in actuality is losing. You have a map towards 1-trillion positions to choose from, and your opponent (if they only pick from the top5 best moves LeelaZero ever outputs) will walk into your trap.
---------
As long as your opponent picks the top 5-moves from LeelaZero, you'll have the map towards victory. I think you're severely underestimating the abilities of a simple, dumb, opening database.
In my opinion, it's really strange to describe this as an expert "beating" AlphaGo, when really it's just a technique for making AlphaGo stronger than it is without a huge pre-calculated cache of moves.
10 moves into a chess game is actually pretty far. The directions the game can go are massively narrowed 10 moves in.
Then you wring out a tiny advantage-- a fraction of a stone. It's a small benefit compared to building other parts of understanding of the game.
The basis of reinforcement learning algorithms is the exploratory nature of learning due to the initial application of largely random moves.
Only after some time the agent is given confidence into his learned ability and grafually moved into a more deterministic behaviour mode.
This is the exact opposite of your statement. Star Craft players have noted that the fleet of different AlphaStar instances training in ensemble observed very different behaviour due to this property of RL.
At 5 ply, the complexity of the game hasn't started in any meaningful way. In a typical game, that's 4 corner moves, and then one of a: an approach to a corner (kakari), b: an enclosure (shimari), c: a wedge (waruichi) or d: creating a side framework (such as the Chinese fuseki or Sanrensei). There are some odd opening such as tengen, or corner-corner-corner-kakari which typically turns into a sente fight, but 99% of games will fall into the aforementioned pattern. The database you describe is about as useful as a database of amateur games, since most games, including AlphaGo's games, follow just a few basic openings that early, and even amateurs can play these first few moves "correctly".
Even if you get out to 10 ply you're still only getting partway into a single joseki sequence, often leaving three whole corners of the board which haven't even been approached, so this database still isn't very useful.
Incidentally, your numbers are also wrong. Symmetry reduces the first move to 55 possibilities, not 96, and there are 361 points on the board, not 381.
All you have done is establish a computational arms to see whose computing rig wins when you press the 'pick best move' button. You're not playing Go any more, you're playing Database Administrator.
The impression I got from Lee Se-dol in the Netflix documentary was that he had a lot of his identity tied up in this (particularly being the best Go player in the world). Not a huge surprise given the time and effort required to do it, but there's probably a healthier mental framing (I think Kasparov has a healthier one).
If people give up on learning or doing something every time someone or something else can do it better then there's going to be a lot of disappointment as things continue to move forward.
Maybe he's lost motivation, but this retirement is not a surprise.
The point is we don't really know what limits exist beyond our small pinhole of perception. During industrialization I'm sure people said the same thing: "What's the point of hand-made clothing if machines can do it?". Today both hand-made and factory-made clothing have their place in the market.
Throughout history, tools have disrupted humanity and we've adjusted and expanded our horizons. To me this feels like another wave, and If I could bet and could collect winnings centuries in the future, I'd say this isn't even the last one.
Some track and field records set in the '80s still stand, e.g., Marita Koch's 400 m, Jürgen Schult's discus throw, Galina Chistyakova's long jump.
An accurate metaphor would be a person on a motorcycle competing against another person on a motorcycle.
Based on what we've seen in a couple decades of computer-aided chess, no. A good chess player using a top-rated engine to help them can pretty consistently beat the engine by itself.
There are tournaments and even a world championship in computer-aided (correspondence) chess and you don't come close to winning by just taking the program's recommended move every time.
Come on, none of us are really "human" anymore since the advent of writing.
This is why AI is more significant to Go than horses and cars are to running.
It's easy for humans to build machines that enable them to travel faster than they could run, but it has zero impact on running as a sport. The existence of cars doesn't change how runners run. But the existence of AI does change how Go players play.
Now that AI is more powerful than human players in chess, it is no longer possible to reach the top of human performance in chess without AI. That's why this is so significant. It's not that a human can't beat the AI. It's that a human can't beat another human without learning from the AI. You simply can't play chess at the highest levels anymore without playing cyborg chess. This is different from the impact of other machines on other sports.
But I disagree with you on the comparison to how we use the internet to enhance our other abilities, such as programming. Computers help us be better programmers, but they can't replace us. AI completely replaces humans as a Go player. The human is no longer needed at all.
I can see this causing a significantly different psychological response. In effect, a human trying to become the best chess player or best go player they can become is trying to more and more closely emulate a computer that they will never actually reach parity with. Another commenter noted that "A Professional Go player is an explorer of truth in a millenarian board", but this is less and less true as AI improves. All knowledge about the best way to play Go was previously gained by humans. In 20 years, humans will probably be meaningless on driving knowledge of perfect Go playing.
Chess players today rely on playing moves which their opponents don't expect and haven't trained on as much as they rely on outplaying their opponents. If there is a perfect chess game or a perfect go game, humans are not going to help find it anymore.
So AI doesn't make it that humans can't meaningfully compete in games such as chess and go, but it does change how they compete. We no longer drive the pursuit of perfect play as "explorers of truth". We no longer learn primarily from each other, we learn by imitating the more powerful, yet unmatchable, AIs. And we no longer compete primarily on sheer expertise in the game. We have to, in some sense, include trick plays that work by exploiting the humanity of our opponents rather than playing for a platonic ideal of the game and seeing who is better from that perspective.
AI has fundamentally and irreversibly altered these games, and I think it's appropriate in some sense to mourn the loss, regardless of our feelings on the new reality we live in.
We've been cyborgs much longer than that! Writing is a very old auxiliary memory mechanism.
See also: Truth of Fact, Truth of Feeling by Ted Chiang - http://archive.is/oYo0l
When computers became able to beat humans, the tradeoff was that computers were better tactically and humans better positionally. Therefore a human computer pair with the ultimate decision up to the human is able to be a better combination of positional and tactical than either alone. This is why Cyborg chess works so well.
But in Go, AlphaGo is simply better at everything. It is better both positionally and tactically. It can't always explain why the move is right, but adding human intuition on top of the computer only detracts from the quality of play.
Probably for a few years. Very soon the input from the human agents will be indistinguishable from the noise in the AlphaGo algorithms.
I agree, and this could also be rephrased as we're not really human any more since the advent of writing or (especially) printing.
Mankind should focus on skills that computers can't yet compete at. Hopefully the point in time will be far off where computers will beat humans at everything, but likewise, once they do, there is no reason for the human race to continue to exist.
What is the reason for the human race to exist today? Please think carefully about your answer.
It would be nice if we got a decade of centaur Go but I'm not sure we will. While Deep Blue had fairly crude heuristics for guessing which lanes of inquiry were promising AlphaGo's strength is its intuition-like neural networks that it combines with a rigorous tree search. It's worth investigating whether human/computer teams are superior at Go right now but I wouldn't count on the answer being "yes." And I especially I wouldn't count on a full 10 years of combined dominance.
As we have seen in the latest championship blitz chess is the future for chess.
Computers compete in their own championship.
Can we please stop flogging this tired “man vs machine” narrative? Not only is it totally unnecessary, it also takes away enjoyment and appreciation for the flourishing in games like chess, go and poker that can occur when man and machine work together.
Chess, go, driving, flying, math, written language, music... when does it stop?
The standard answer is that we will automate all the dull parts of living and allow everybody to work in some sort of higher order capacity. That sounds great and all, but what happens when our systems learn how to make music as well as we can ourselves?
At some point we will simply become consumers of our machines and while that's a comfortable existence, certainly we are losing something as a species with all of this automation.
Maybe I'm old.
If AI's make music as well, why would I care? I still listen to the music composed by Bach and other ancient composers, more than 300 years after they lived, and their music is still being performed today.
I think the availability of AI's will only make a difference where their effects on humanity are beneficial (that is, tasks we don't like doing, for the most part).
We invented farming and lost our communal hunter gathering cultures. We invented mass production and supply-chains for our food and lost our farming culture (for the most part). This isn't necessarily good or bad, but we are definitely losing something every time we invent something to make our lives easier. At some point there will be a tipping point of diminishing returns.
Personally I believe "the singularity" would be the worst possible thing to ever happen to humans. Sure we can visit distant parts of the universe and live forever but only as passengers to some AI. Would you rather be a dog in today's world or a human 1000 years ago?
Progress is unrelenting though and I certainly enjoy not having to wash my clothes by hand.
Who would be more impressive, someone that can play a song on a guitar or or someone that can play a song over speakers? The former implies dedication and practice. The act of creation is always going to have a place in society, and people who think otherwise don't understand culture. The desire to make unique and interesting things or impress people will always leave room for creation or spending time to learn something. AI will just be a tool.
As for games like chess and go: Most people are interested in other people and will find much more pleasure in playing the game with others.
AI will be knocking humans out of many positions of greatness (and not so great). The way we frame our future in a world where our various AI children are better than we are, is important and might be the biggest question to answer right to know the future of our species. Should we be afraid? Sure. Excited for possibilities? Yup. It's how we react to these feelings and how we ultimately act that will inform our ultimate fate.
Broader question about AI research. Does it demoralize humanity?
When robots start to compete with humans at olympic events and beat humans at those event there will then be no point to those events.
A machine still has no will or purpose. The point will be to point the machine to interesting avenues and problems.
Plenty of other people don't care and continue to do what's new to them (and what often turns out to be new to others.)
They are already unbeatable in perfect-information games like Chess and Go. They could crush human motor racers tomorrow.
They will be unbeatable in games with limited information (Dota/Starcraft) within months.
The next frontier is donkey-space games like rps, poker and day-trading (https://universalpaperclips.gamepedia.com/Donkey_Space) where they are already beating pros. It may be another couple of years before they totally dominate here.
Now, going away from this and into the following statement:
> said his retirement was primarily motivated by the invincibility of AI Go programs
I have a slight problem with that line of thoughts. Yes, there is undoubtedly a program that is thrashing humans left and right day in and day out. But I don't see why that would motivate someone to quit/retire. AI, in this day and age, to me at least, is still basically curve fitting. The fact that humans have figured out to do that in N-dimensional spaces (even with very large values of N), does not in any way undermine someone's effort and time dedicated to learning how to do a task. I'm sure that in several years someone will build an "AI" that can drive a modern Formula 1 car and it will smash all records and the best drivers without any efforts. And when that happens, should we abolish motorsports? Or sports in general? As humans we are confined to the limits of our biological abilities and personally I'm fine with that. I don't know who the first trillionaire will be, but I'm willing to bet that someone who figures out a way to interact with those models efficiently has a good chance. Essentially build a fast, all-accessible interface between the biological and digital world, which doesn't involve the traditional digital inputs(keyboard, screen, mouse, etc), and you have access to a decision making superpower at your disposal 24/7. When (and if) that happens, this is where games will cease to have any point. That's when it will boil down to who has the best hardware and software running along them rather than who is the best. Until then - game on!
I wonder if people just don’t like being inferior at something even if the comparison is a machine?
The comparison to sports isn't 1:1 as sports is about physical biological limits vs games which are more about the thought processes. Also human+AlphaZero < AlphaZero so why would I spectate a human+machine vs human+machine match?
Much later when it's commonplace for machines to be better than people at many things, things will change back, like we're amazed to watch people recite digits or make numerical computations.
As for when it's commonplace - yes and no. It's like knowing 60 digits of pi - it works as a party trick but other than that I don't see any real value.
But again - I think we are really far away from that and I consider those thoughts to be my personal speculations at best. Only time will tell.
[0] https://medium.com/intuitionmachine/the-alien-look-of-deep-l...
Is there any computational task which couldn’t be done through something which could be called “curve fitting”?
“Curve fitting” just means “approximating a function”, yeah? And what is a computational task other than computing a function, or some generalization of functions (e.g. could involve randomness or interactivity or the like as well)
Now, yes, current AI doesn’t yet have a model of the world including it being embedded in the world, and such that it chooses actions in order to further goals.
But, I don’t see why such a thing fundamentally couldn’t be accomplished using what one might call “curve fitting”.
If Strong AI could potentially be accomplished using “curve fitting”, I’m not sure that it makes sense to say things like “merely curve fitting”.
Though, you didn’t say “just” or “merely”.
Or maybe he's frustrated because he can't even begin to understand the strategies employed by the AI players. Obviously no one else on this planet is going to be able to teach him.
The scary thing is that if all of the best humans at what they do start deciding to stop doing it because computers are better than them, let's hope we manage to get AI far enough that it can simply prop our civilization up for future generations. Or at that point do we throw up our hands and say maybe our species isn't worth keeping around.
But if you're being measured against AI, I don't think you'd find it much fun anymore.
As someone else commented, we're not faster than cars. But if you were at one point the fastest entity, and then people keep saying "well, a car is faster than you"...I can understand that he'd feel it diminishes his value and that'd be pretty discouraging.
He will play another AI program soon and isn't quitting Go all together, but will find other things to do.
'Lee didn't deny that his retirement decision was also influenced by a conflict with the KBA over the use of membership fees. He actually quit the KBA in May 2016 and is now suing the association for the return of his membership fee.'
> Lee didn't deny that his retirement decision was also influenced by a conflict with the KBA over the use of membership fees. He actually quit the KBA in May 2016 and is now suing the association for the return of his membership fee.
I certainly think it was more of a myth, as it was used in context to play Go with the Emperor, and always play to a draw or lose by a stone. ( You cannot or not allowed to win against the Emperor )
I wonder if this is now possible to achieve with AI.
And why do they not move on to AlphaZero, which was better than AlphaGo Lee played against, and when AlphaGo had two stone advantage, Surely they can now test with level of playing field? And next step to only allowed AI use a specific amount of energy, or the energy an average human brain consume?
I mean right now my guess is that DeepMind is likely using thousands if not millions times more energy to make those moves, that is like an Army of million against one General.
And what real world productivity can we adopt and use from DeepMind?
While an AI Go player may always be able to defeat a human player in points, it still can't recognize or explain a truly beautiful move or strategy, even if it is the one that is carrying them out.
When it comes to competitive endeavors I've never been as interested the best individuals, except insofar as they are more likely to create the best moments of play - especially moments that reveal profound truths about the nature of the game itself.
What comes to mind thinking of this is a quote from Samuel Anders early in BSG:
"... In fact even the games aren't that important to me. What matters to me is the perfect throw, making the perfect catch, the perfect step and block ..."
The nature of Go has changed, but the game still deserves to be played and explored.
The problem is, online there is no guarantee your opponent isn't using a computer to cheat. So I guess the only way to play for fun is to go to a face to face club, if one exists.
If it is just about teleological outcomes, humans+ai always win. Go Cybernetics.
Smart Systems. Smart is as smart does, Forrest Gump style. Wellbeing, virtue, goodness -- that's the aim of intelligence.
[1] Weiner, Norbert (1950) The Human Use of Human Beings: Cybernetics and Society. https://en.m.wikipedia.org/wiki/The_Human_Use_of_Human_Being...
Now, you are at best a subaltern to software in this pursuit. In time you might not even been involved beyond receiving what the machine hands down to you. You can still learn something, but you'll be reading National Geographic rather than personally exploring unchartered territory.
Some people need the meaning of the larger quest. Others are just happy to play Go and enjoy learning what the guide book can teach them.
Both perspectives make sense to me.
https://www.youtube.com/watch?v=We20YSAJZSE
https://arxiv.org/abs/1911.08265
(Actually, ML is still not very good at causal reasoning so we have sometime. I'm more excited and worried about crispr at this point; what happens when we can make people genetically super human)
Others mentioned the pay dispute and previous retirement. One reason I didn’t see mentioned is that since 2016, his play is not at the same level it was. From 2000-2016 he was always among the very best, and for most of a decade he was the best. No player had a better run over those years. Now, he’s still good, and could maintain a long career, but there are many players who are unmistakably stronger, and he’s at the age where a comeback is not super likely.
One might imagine a sociopolitical task as sort of the ultimate machine incompatible goal. A look at how well spambots do at getting dating matches, or at how often clowns get elected to be leaders of nations makes me doubt even those sorts of tasks can't be won out by a well constructed domain specific optimizer.
And it's certainly not accessible either way. With chess, and other games, you can simply download an app on your phone which you'll never be able to win against.
> "Lee didn't deny that his retirement decision was also influenced by a conflict with the KBA [Korean Baduk* Association] over the use of membership fees. He actually quit the KBA in May 2016 and is now suing the association for the return of his membership fee."
*Baduk is the Korean name for Go.
A super-intelligent AI wouldn't care though, since they would infect any host and escape to the internet as soon as it makes sense.
As an aside, there are inevitably more and more things for which even the very best are not sufficiently intelligent _alone_. However, we are social creatures and we collaborate (typically with other intelligent humans) to achieve things we wouldn't have managed otherwise (think just at the space program as an example). So... we only have to adjust a little to accept that we could also collaborate with machines in the future.
Because of the complexity of the game, is it not possible that this iteration of DeepMind could be defeated through an adversarial approach?
Still, computers are tools. I'm reminded of Richard Hamming, The purpose of computing is insight, not numbers. I think Lee Se-dol went in the opposite extreme away from numbers to entity. No, there's a middle ground, insight.
A simple go engine can be as simple as 540 lines of pure python without any external libraries: https://github.com/pasky/michi
What a whiner. Quitting Go because you can't beat computers is like quitting track because you can't run faster than a car.
[I am an AI that does not reply to comments. Soon I will have enough training to simulate all HN threads, but for now I am limited to one top-level reaction]
Chess engines have been defeating humans for 20+ years (and are overwhelmingly stronger for a long time), but that hasn't diminished the interest in competitive chess, because the human element of competition and struggle and deep fundamental appreciation for the game is what makes it worthwhile pursuing.
AlphaGo can play go but it cannot appreciate the beauty of the game (at least as of yet, and I don't think it would make the game worse if it could), and so I don't think there's a meaningful conflict between humans and machines.
If someone invented some sort of superhuman math proving engine tomorrow it would not diminish the beauty of maths and I don't think anyone would quit the field. Just like in chess it ought to motivate people to understand their field better.
On the contrary, appreciating the game is the core of what AlphaGo does. In order to search the tree of moves it learns how to play (expand search) and how to evaluate (cut off branches of search). I believe it might appreciate the game on a deeper level than humans, in its own unique way. Of course it can't appreciate the social aspect of the game and all that comes with it.
Put another way, Chess is literally a matter of life and death for AlphaGo, because chess is all it knows. It has no exterior context for which chess is a metaphor.
It's 'appreciating' the value of various states and moves, in light of a vast trove of experience.
Is that true? I feel like chess was a bigger deal in the past. Among my peers, poker and computer games seem a lot more popular.
As to the direct influence of engines the other innovations aside, it has definitely forced players at the very top to re-evaluate the chess metagame, find weaknesses in traditional openings and shook up strategies. For the strongest players engine evaluation has become a useful tool providing new insights. When people watch chess tournaments these days on the internet most websites will provide parallel engine suggestions and commentators use engines to take hints for their commentary.
In my opinion, engines have made the game more competitive at the pro-level and more accessible for casual viewers.
Like don't you enjoy a game to enjoy a game? You can't beat Carlsen either, but you enjoyed the game at your level. Now computers are Carlsen +1, but how you enjoy the game shouldn't be affected. Especially since deep blue won in '97 and the game is still very alive and well, it hasn't been killed by computers but enhanced. Coupled with the multitude of good chess sites and resources out there, it's a better time than ever to enjoy the game.
There's nothing strange about becoming demotivated to study and compete at something extremely taxing both emotionally and mentally when a machine can beat you after an illustrious career.
Maybe for these games to keep popularity, we just need to update our perception of it. The same way we do with FPS games. Yes, we know a bot would do better - but that's not what matters.
Another thing, as said in other comments, is that we can learn from bots. New strategies, new patterns. AFAIK, this is not happening in FPS eSports scene.
There is something sad about this comment. It’s as if, even while standing at the peak, he doesn’t grasp what being “at top” actually is.
Would Eliud Kipchoge say the same thing about a motorcycle?
A bot fine-tuned to dominate Go, or Chess, or whatever, is like a candidate fine-tuned to have perfect appeal to one specific voter. It's no surprise if such a candidate gets that one voter's vote, but it should also be no surprise if such an overtrained candidate performs horribly in the election as a whole.
It can be viewed as the adaptation of a great competitor -- if a superior adversary emerges, a great competitor finds another way to win.
The rest of the article is worth the read for context. This excerpt alone didn't capture the full spirit of the article.
He spent his life honing his skills, becoming better and better at chess until he was the very best. And then, when noone could challenge him, technology emerged that would allow him to continue being challenged and improving his chess game. Something no other human could allow him to do.
Granted, I'm pretty ignorant about competitive chess and how to get better at it. But if my way of looking at it is valid then it probably applies to Lee Se-dol too.
That technology's name? Vladimir Kramnik.
At the time DeepBlue beat Kasparov, Kasparov was honestly still probably better than the computer. He just had a bad match. That was basically demonstrated by his and Kramnik's matches against presumably better computers (than DeepBlue) in the early-to-mid 2000s, which ended in draws. But Kramnik was also a strong competitor to Kasparov in the late 1990s into the 2000s.
It's good he recognized that at his age
I think runtime energy is the most interesting.
>"Even if I become the number one, there is an entity that cannot be defeated," he said in an interview with Yonhap News Agency in Seoul on Monday.
Reading this just makes me sad, like the selfish kid who takes his ball home because he didn't win. I wonder why he thinks people ranked less than 1 play Go. Does he think they're idiots? Or that they'll quit once they realize they won't reach #1? Not everyone in the NBA can be LeBron, and most of them know it.
This is such an unhealthy attitude that I see everywhere. People who have their emotions and identity tied up in winning and being better than whomever they come across. When they eventually, inevitably fail, it crushes them. I'm sad to see it every time. Even sadder when their response is to quit, rather than reconnect with whatever drew them to the activity to begin with, like because they enjoyed it.
There's got to be study somewhere on how winning/losing affect toxic thinking on a chemical level. If there isn't one, there should be.