But also in this analogy if the bug travels long enough in what to it seems a straight line, it will wind up back where it started. Does this hold true for the universe as well?
Let's say the universe stopped expanding tomorrow, and didn't shrink. If someone got in a spaceship and traveled in (what seems to them) a straight line for long enough, would they wind up back where they started?
If not, how can the universe have no edge? How can a you always see another galaxy straight ahead, in a universe with a finite number of galaxies? The universe doesn't just create new galaxies. You have to start recycling galaxies at some point.