Agreed. None of this is magic, and the vast majority of us have been handing this data out to SaaS providers of all sizes and shapes for decades now, for free. Many HN people even _build_ those platforms.
Would I like to see more controls around this? Yes, absolutely. Having some random app be able to read this data with only a single permission barrier is room for improvement. I would also like to see more tooling included to inspect and correct this data. Something like a Monica[1], but local and built on local data. Suddenly address book data is no longer a list of names and numbers, but a part of a data structure that you can use to surface information, like friend's preferences or vacation photos together. Not everything that collects data is insidious and a Black Mirror episode in the making.