It might help to know that the "instrumental magic" is that he literally adds a beat. Each bar has 4 beats and he switches where they're clapping by giving one bar 5 beats. You kind of have to stop/restart counting to intellectualize it.
Of course, but he adds the beat so smoothly and unobtrusively that the ordinary listener hears no glitch in the matrix. That is where the magic comes in.