It’s more nuanced than you might think. All of the other elements do contribute to the fun factor. As a former game developer, there were times where adding particle effects or even sound suddenly made a sequence fun, as if suddenly a threshold had been crossed.
Human beings do respond to rewards and payoffs; it can be the satisfying sound of a coin being collected or animation of your character wall-jumping and grabbing onto a ledge. These things DO matter.