I don't know how much this applies to California, I think they cap property tax increases there, not sure how the rates differ by town?
A single state-wide standardized marginal property tax rate would probably work best. Those with $5 million+ single family homes should be paying a higher percentage to discourage that type of housing. Additionally that tax money could be collected at a state level and distributed more equitably (to towns that aren't as wealthy).
Ultimately single family homes need to be phased out in these kinds of places and replaced with higher density along with mixed zoning. Mixed zoning should reduce the need for more car based infrastructure which is extremely expensive and allow more efficient public transit to be built. That would lower costs for regular people since they wouldn't need a car to get places.