iPhone gives you lots of controls around location history, and certainly there is nothing in the iPhone ecosystem where they want you to contribute reviews or human analysis to help them with gathering data. I trust that these controls work. My cell phone provider knows where I am to route calls, but I trust that they aren't also keeping the data for fun / marketing / etc.
The suggestion that it couldn't happen on other devices is certainly at odds with technical capabilities; the suggestion that it isn't happening is a different one entirely, and is not crazy.