None of that data is actually particularly scary by itself, although I wouldn't enjoy the thought of it all being out there.
What Cambridge Analytica was bragging about was their big data model promising to distill users' data to a psychographic profile.
There's this story about 30 "likes" (of books / artists/ movies/ etc) being enough to predict peoples' sexual orientation with higher accuracy than the coworkers sharing a desk with someone.
The large publicity for such "big data" methods in the last years may have contributed to the change in public opinion, and (part of) the reason Facebook is just now getting its 15 minutes of infamy.
In our circle around that time people were calling out apps that required these permissions and recommending that users not authorize them if it was not obvious why the app would require that kind of data. John Gruber comes to mind as one of those people. These calls for caution were not in the mainstream though.
Edit: I believe this API contained info like favorite tv show or band if those fields were filled out in your profile, but again I’m fairly sure that your own privacy settings could have limited this if you had them set to draconian levels. So in other words, yes this API was limited to publicly available data, more or less.
The worst, for me, was posting on behalf of other people and getting replies to your app like "I'm so glad to hear from my favorite grandson after so long!".