It depends on the game. If there are a lot of game simulation calculations to do for every frame, then you're going to be CPU constrained. If it's a storybook that you're walking through and every pixel is raytraced using tons of 8000x8000 texture maps, then it's going to be GPU constrained.
Most games are combinations of the two, and so some people are going to be CPU limited and some people are going to be GPU limited. For games I play, I'm often CPU limited; I can set the graphics to low at 1280 x 720, or ultra at 3840 x 2160 and get the same FPS. That's CPU limiting.