Is it not a possibility that this galaxy was already much further from the "center" of the universe 12 billion years ago? I am not an astronomer by any stretch.
If there is no centre then either the universe is infinite, or it wraps around on itself like a balloon?
[1] http://bottlerocketscience.blogspot.co.uk/2014/05/book-of-xx...
The Big Bang is better understood as a Big Stretch, which is still ongoing. As time progresses there just happens to be more space added between things. The balloon analogy breaks down because the galaxies themselves, or the dots on the balloon don't get bigger due to gravity. The expansion of space is only relevant on huuuge distances, not interstellar or even intergalactic, only when one gets to galaxy clusters and superclusters.