It's one of my favorite dance videos of all time. The bemused expression on his face as he's dancing is priceless. Not to mention a pretty decent track from Fatboy Slim.
Christopher Walken worked in a number of Broadway shows so it's not surprising he can dance.
Check out this compilation of him dancing in different movies. Excellent editing...
Spike Jonze’s stories about directing that music video are a great listen: https://m.youtube.com/watch?v=C8Yz9OLXu8Q. I never knew Christopher Walken had a dance background!