If we compare with the Roman Republic, not being centered on Rome is a big change. However, many emperors spent little time in Rome, and when there was a civil war it was apparently common to declare some other city a “New Rome,” so that idea was going around. Roman citizenship was considerably more flexible than other ancient empires, including people of many ethnicities, and was eventually extended to every free inhabitant in the empire. They didn’t just call themselves Roman, they legally were citizens, despite not living in and never going to Rome.
We could instead focus on the similarities, like not having a monarchy. Anyone could be chosen emperor if they were in the right place at the right time. (Originally by being a popular and effective general, but later acclaimed by the crowds in Constantinople after political maneuvering.)
So I agree that there’s a “Ship of Theseus” aspect to it, but it seems like a consequence of Roman flexibility, allowing the empire to evolve into something rather different over the centuries.
(Apparently Christianity resulted in far more religious strife, though, compared to polytheism. As a state religion, it seems like it was a turn for the worse, and the history of the many schisms over nonsense is rather tedious.)