So the thing CNNs are really good at are perfect for small images, but symbols already have that thing done. When CNNs and RNNs are used together (e.g. image segmentation), it's almost as if the CNN is creating symbols and RNN s processing them.
Or, you know, maybe I'm far off. I'm in no way qualified to talk about this (just a fan).