If you want to intuitively understand why this particular 4D construction is the right representation of a 3D rotation, then I highly recommend 3blue1brown's explorable interactive video series on the topic:
The interactive videos alone are quite the technical feat, but after going through it, it's honestly hard to imagine fully understanding this topic with less technology (or with a less incredible teacher!)