Could it output a decent implementation of an algorithm if you were to feed it the comment describing it? How about more general statements about input and output.
The holy Grail would be to code just by describing what you expect the code to do. A few plain-language (maybe a more structured subset?) sentences stitched together, the API glue autocompleted.
And for reverse-engineering? Train it on drivers, then feed it packet captures. Could it make sense of the data?