I really disagree. They probably saw one or two famous paintings by him that they really like. Here’s mine: https://en.m.wikipedia.org/wiki/The_Old_Guitarist
Once that happens though it opens the door to appreciating other pieces.
I have experienced that same phenomenon with bands, where people say "X" is great and I hear a song and don't "get it" until I find some other song by them years later and it all sort of "clicks" in a way it originally didn't.
With that said, there are definitely people that try to say "I like X" to fit in. I just don't know about the 50% bit in the OP, but then again, 90% of statistics are made up.
BTW -- The Old Guitarist is on permanent display at the Art Institute of Chicago. It is wonderful in person if you haven't been yet.