Horrible description of UX designers as "...often judged solely on how the product looks". You're working with visual designers, not UX designers.
He's not saying they can't be or shouldn't be judged on anything else. He's saying that, in practice, the person they're reporting to judges their work solely based on how it looks.
It doesn't matter whether or not this is true anyway. It's just a made up example to illustrate the idea.