Likewise, you could say “Tell my boss I’m not coming in tomorrow” and it would have to know who your boss is.
We could get super angry about this, but seeing as it’s fully local and doesn’t leave the device, it really doesn’t seem like a big deal. Is it much different to your car remembering who you call and where you go at what times for navigation purposes?