This is because the Bay Area is a highly desirable place to live and will continue to get more so as climate change gets worse but the Bay Area stays gorgeous.
Crime is a problem to solve in any Western urban area and is particularly bad here now. Congestion is another problem to solve.
Manhattan has solved both to a degree. I’d imagine we can too.