C'mon, it was a casual joke and no harm done. Also punching someone weaker is a simple act, but taking on someone stronger requires courage.
Does it fit the somewhat quirky (but by far not unusual) interview process? Yes
Is it a sign of a moral flaw? No