It's not necessarily dismissing them. Face it, some people are mediocre and unambitious. It doesn't say anything about what kind of people they are, but it says something about how they are intellectually and how pleasant working with them will be.
You can judge by their reaction whether they think you're saying something about what kind of person they are.
I still maintain it says more about you than them, though.