This is a very natural avenue and an active area of research at Google/Deep Mind. Stay tuned...