I am not sure how much I would give credit to the idea that the neural network 'gets' anything as it is written in the article.
> Yet, the network knows that the Romney Camp criticizing the president is a plausible headline.
I am pretty certain that the network does not know any of this and instead just happens to be understood by us as making sense.