I've actually been experimenting with this with the goal of doing transfer learning for robotics. I'm surprised by how poorly they perform.