Right, but consider the source of the information we're seeing here. Google is not in a position where they're encouraged to spin this story in a positive light for the employees in question.
The calendar notification feature does not discriminate, but it also doesn't automatically leak data to an external source. So if, hypothetically, one believed a coworker was involved with a project the company was trying to keep hushed up (such as a search engine built conforming to the design constraints of the Chinese government, or an object recognition tool for military applications), one could keep an eye on the evolution of that project by turning on calendar notifications and observing what meetings that coworker is invited to. But if that coworker also puts "Doctor's appointment" on their work calendar, the observer will of course be notified about that also if the event is made (internal) public.
Now, once the observer is notified, they may have chosen to leak to an external source "Hey, a name-notable VP appears to be having a meeting on Thursday titled 'PROJECT: DEFINITELY NOT FACILITATING CHINESE CENSORSHIP'." That doesn't imply they chose to then leak "And they have a doctor's appointment Friday."
Google has made the claim the individual in question set up notifications, and those notifications may have caught medical appointments and family activites. Google has made the separate claim that some information was leaked externally. Google has notably not made the claim that doctor's appointments, family activities, etc. were leaked externally.
... and the privacy concerns we honor for people's personal lives do not necessarily extend to the work they're quietly doing on things the public may find unacceptable.