It's great to see a postmortem with this level of detail, fairly quickly. It's also great to see Joyent hang the blame on the system that allowed rebooting every server, and the poor recovery from that failure, rather than continuing to throw the operator under the bus:
"...we will be rethinking what tools are necessary over
the coming days and weeks so that "full power" tools
are not the only means by which to accomplish routine tasks."