From my understanding they can train the agent to accomplish a fairly complex task, by first "training" the agent to be able to accomplish simpler tasks that are perhaps only slightly related to the final goal. If you want to learn to run, first learn the more basic skills of balancing, standing up and walking. The agent appears to decide what task it wants to try to pursue, but still receives signals about all the tasks available to it, and has a way of planning and following through on what future tasks to carry out.

I wonder if there's any way to automatically generate useful, simple goals?