There are several reasons why the prices have gotten so high (lack of supply, politics, etc).
But don’t expect to move your Texas ranch or Midwestern single-family-house lifestyle to SF with no compromises.
But in return for your compromises, you will get quite a bit in return.
Is it worth it? That’s a very personal decision. For many, it’s not. For many, it is.