Cost of living affects startups in a number of ways, including the price of office space (or home rental, in the "working in the basement" stage) and the minimum salary expected by your staff (once you start hiring).
However, the areas with higher cost of living also tend to be desirable places to live, with an existing concentration of business and tech-savvy people.