Tensorflow does everything Theano does, but with the backing of the big G. That's basically why Theano is being sunsetted.
As I understand it Tensorflow does not handle a large number of variables very well[0], which is the killer feature of NUTS in pymc3. This makes it a bit of a non-starter for pymc3.
That comment states that TensorFlow does not handle a large number of operations well, not a large number of variables. There's a large difference between those statements :). But yes, the general point is correct, especially for models that do not use many matrix multiplications.
Oops! Right you are. I just recalled that there was some issue with a large number of <insert important item for MCMC here>. I should have reread the threat before linking it.
Keras is pretty cool and can already use Theano and Tensorflow as a backend.
Not sure how this comment relates to PyMC3 though - PyMC3 is for Bayesian statistical modeling with MCMC. It uses Theano as a backend. Keras is a specifically for neural networks.