I imagine this is the way we get to "true AI", or AI indistinguishable from our own. We train it with a simple virtual environment, that we can gradually increase the complexity of, until it mimics our own. Then we can download the AI into a robot. Boom, it's that easy :P<p>One interesting outcome of this type of AI is that no one knows what the robot's thinking, since no person designed its brain. The brain evolved, just like ours did (but over such a shorter period of real time).
I've seen much better videos of simulated walking structures, e.g. [1].<p>[1] <a href="https://www.youtube.com/watch?v=pgaEE27nsQw" rel="nofollow">https://www.youtube.com/watch?v=pgaEE27nsQw</a>
This seems pretty obvious for practicality. The AI can play thousands, or millions of games in different VMs 24/7 and be exposed to a radically higher number of simulated circumstances versus the comparatively plodding rate of genuine interaction.
I'm having a hard time understanding how the body can stay stable at all. For the emergent behavior to appear, you would need the AI to control the body pretty precisely, but if you just had a "random" AI the body would never stay up straight.<p>Seems hard to imagine any amount of generations that get the body up to "stand". I would have maybe expected it to crawl on all fours.
It seems like fighting games such as Street Fighter or Tekken are a perfect fit for Self-Play.<p>Anyone at OpenAI attempted to build such an agent? Are there any AI research platforms designed specifically for player vs player fighting games? As far as I know, elite human players are still massively dominant. Even though it would make for an exciting matchup. But giving the complexity of actual fighter competition, with combo attacks, power meters, time limits, etc. There is an absurdly high dimension of training variables required.<p>I'd actually like to try and take a step back and apply self-play to something lower dimensional. Perhaps a 2D Tron Light Cycle sim. And see if some truly unexpected strategies arise ;)
Imagine a robot police force, based on this technology. If a suspect were to attempt to tackle or evade the police, it would react accordingly. This robot police force would be networked, so all police nationwide would learn from every suspect encounter. You may have seen movies where the human "outsmarts" the robot, but when robots are hundreds of steps ahead of humans, how do we defend ourselves?
Evolution created consciousness as we experience after billon years of brutal trial and errors. Creation of consciousness will endanger mankind but from evolution point of view, evolution will jump to a next level of evolving. That something evolution could not created directly by herself but her best child mankind created for her.
just a reply to a common reply to this kind of things<p><a href="http://idlewords.com/talks/superintelligence.htm" rel="nofollow">http://idlewords.com/talks/superintelligence.htm</a>
At 0:59 in the movie, I noticed another kind of emergent behavior: kicking the goalie where it hurts after it defends the goal. I would call it "retribution".