Yes, because of the skill set mismatch. What is confusing about this? My supercomputer cannot feed you today. This isn't elitism, this is reality.
It also seems to imply that the rest of the world would tell you to stop working on your supercomputer and go deliver rice in Africa or something. This actually is elitist and condescending, as it assumes that just because people are starving today they would be unable to understand the value of your work. You should give the rest of the world more credit. That's the elitism.
So until you start delivering bags of rice yourself or dedicate your life to non-profits and the collective good, remember that every time you point a finger three are pointing back at you.