Rome was the center of the Mediterranean world during the early church, the only city with a million people.

That's the only reason the Roman diocese became dominant. Not any sort of lineage or pedigree.