I wrote a little script for viewing the data as a heatmap a while ago, if you're interested: https://github.com/olane/locationheatmap

Yes, I have the exact same feeling. I like seeing all the places I've been, but I hate that google also sees all the places I've been.

I've recently installed Owntracks on my phone and have started logging all my location updates, so soon I may be able to just drop the google location tracking.