I think this type of Census data understates household incomes. I am not exactly sure why, but Atherton comes in at about 400k a year per household. That is a lot, but doesn't seem like a lot for Atherton.
If you sold your company, aren't working at FB/goog/etc and are sitting on a ton of stock holdings, your income is going to show as near $0