Path-dependency.
Urban rankings are quite surprisingly durable, with the US being among the worse examples of this, given, say, the rise and fall of numerous formerly-great cities, say St. Louis or Detroit, or to a lesser extent Boston or Philadelphia.
Globally, Rome, London, Paris, Tokyo, and other major metropolises have sustained themselves for centuries. In cases, millennia.
The Bay Area's biggest risk is likely its high cost of living given induced housing constraints. If an alternative centre emergess, as Los Angeles did in the 11920s, following the 1906 fire and earthquake, plus San Francisco's transport and water limitations (neither the bridges nor Hetch Hetchy existed at the time), as well as LA as a resource hub (oil). That advantage remained until the 1990s defence contraction, which hammered Los Angeles.
If you really want to see durability of prestige, though, look to universities. Virtually all the great mediaeval European universities remain notable, and several (Oxford, Cambridge, Paris, Leipzig) remain world-class. In the US, Harvard and Yale (among others) pre-date the country itself. Even in California's public university system, founding campuses Berkeley ("Cal") and UCLA, founded in 1868 and 1919, respectively, greatly out-rank subsequent expansion campuses.
(UCSB, 1944, Riverside; 1954, Davis, 1959; San Diego, 1960; Irvine, 1965; Santa Cruz, 1965; Merced, 2005. UCSF medical school, 1873, is not a general-education campus.)