Hacker News Reader

Comment by datums | Hacker News Reader

Todo:

Move the blog/status site outside your network (linode.com)

Work on a process to try and follow if you have another outage.

   - One person to handle communication (blog post / respond to users)

Work on a faster way to recover from such a failure. Maybe have a read only version you can switch to "maintenance mode" ?

Done:

Probably the biggest outage you'll face.

20+ outages don't usually happen.

Learning from it. . .

View on HN

eBay had some really long outages, and multiple. I'd say a site which has had one 20h outage is way more likely to have similarly long outages in the future -- it demonstrates that neither the technical nor procedural measures are there to prevent them.

Of course, once you have enough 20h outages, you dont have to worry about the problem anymore.

EDIT - originally this comment started with "Wow, set the snark to stun!", but the parent has since been modified, which eliminates the need.

We've all had too many examples of bad pr-attracting events and their fallout over the years. A wise man wrote 'One shouldn't be forming a(n incident-response) team during a crisis', and I don't expect different here. Do I hope for better as someone who uses and admires the Tumblr platform, and expect more communication next time? Yes.

The quantcast graph pointing to the 1 _billion_ increase over the past _two_months_? Easy to play armchair qb to that, but by jeebus, it's almost surprising they made it this long.

they had someone responding on tumblrhelp with chat and sympathetic words throughout most of the outage.

Reply on news.ycombinator.com