But they don't seem to connect the dots and only see Google here. Yet many other parties already have the same data about them, e.g. mobile carriers.
In 2011 a delegate of the German green party asked his wireless carriers for his location data and made a decent visualisation from it, provoking a discussion about metadata: https://www.zeit.de/datenschutz/malte-spitz-vorratsdaten
Given that location history is turned off by default and that they, unlike e.g. mobile carriers allow you to delete or download your own data in raw format any time with a button click I am less concerned about it than about other current internet privacy topics. I may be wrong.