The water is indeed cold most places here. But once you get down to Santa Barbara or better yet Long Beach you can find the occasional beach with warm water.

It's some combination of the very deep water being rather near shore and beaches that get directly blasted with the cold water streaming down the coast from Alaska. Remove/minimize those 2 factors and you can start finding warm water.