Seven Rules of Thumb for Designing Web Experiments [pdf]

Good post. A bit intimidating at first, but this paper has some real insight and is worth a read.

What makes this paper so good is that the opinions are primarily data-driven, not intuition driven. Which leads to insights you can trust.