Carnegie Mellon has (had?) a robot called CHIMP that worked in similar fashion.