So what's up with that differentiable stack? Is that similar to what the Facebook people were doing on learning addition?
It is indeed similar to some work from FAIR, where one of the tasks was binary addition: http://arxiv.org/abs/1503.01007
There is a lot of work around this going on at the moment. Google's neural Turing machine is a similar idea.