I mean, if you’re backing your phone up, you’re basically giving them free reign over your life. Of course there’s location data, and there’s every conversation you’ve ever had on there too.
It’s a matter of expectations: You’re handing your data over to Apple for them to back it up; You’re sending photos via Facebook to share it with friends, and location data isn’t shown anywhere.