The raisin bread is a 3D expansion in 3D space. So from the viewpoint of a specific raisin the others are moving differently depending on what direction you look and you can use that to determine where the center of the bread is.
The balloon is a 2D expansion in 3D space, which is a better analogy for our 3D universe expanding in 4D space. From the viewpoint of a particular dot you see the exact same thing no matter what 2D direction you look. There is no center.
I agree that the balloon is more confusing, but it is more correct in that it doesn't lead to ideas like "the point where the big bang happened".