But here's why some people probably don't like personalization: It's invisible. There is nothing on the results page that tells you whether your results are personalized or not. Sure, you can look at whether the browser is in incognito mode or you can look for some parameter in the URL, but these things require that you already know about personalization.
In contrast to personalization there are various indicators that a page is localized. The most prominent is obviously the language of the text. As soon as all the search results are in my local language it is very obvious to me that I got localized search results. I can also detect localization by looking at the Google logo on the homepage (localized versions have the country name in grey text below the Google logo), by looking at the language of the Google interface, by remembering the domain name I used to access Google and by looking at the sidebar on the left that even displays a guess of my location on the city-level.
There are no such indicators at all for filtered/personalized results. Every user around me starts with the same version of Google results. That's how everyone got acquainted with Google in the beginning. Same results for everyone. There is no reason for a user to question that until you see the differences by comparing search results, which most users won't. Someone who doesn't happen to work at Google or didn't hear about the "filter bubble" can't know that search results will start to diverge from vanilla results over time.
So personalized Google results violate the principle of least astonishment.
While I can't speak for other people, I think that the concerns that some people have about this are rooted in the fact that you can get trapped in some sort of feedback loop without ever knowing. If you could see that your results are personalized you could compare them to unpersonalized results and decide for yourself which you like better.