Hacker News Reader

Comment by patio11 | Hacker News Reader

I implemented Stripe for BCC, too, as an experiment. (I was going to milk a blog post out of it, but all my A/B tests so far have been pushes versus using Paypal, so it wasn't important enough to write before Christmas and I've been swamped since.)

It is every bit as easy as Justin says. BCC's integration was in production in 3 hours, including the wholly-new purchasing flow that my site required to support it. No hitches since then at all.

P.S. I am not unhappy in any way about Paypal, I just experiment with things all the time.

View on HN

Are you A/B testing Paypal vs. Stripe, or Paypal & Stripe vs. Paypal alone?

EDIT: Just noticed your post breaking down what you've looked at. Thanks again for all your transparency.

have you seen an conversion differences in your A/B tests?

That's the push part; implying that the tests have been about equal.

Yep. Technically speaking, I got three null results: not enough evidence to reject the null hypothesis (that A was about equal to B).

Specifically, I tested

1) Paypal + Google Checkout (my previous arrangement) vs. credit card (Stripe) signups alone

2) PP + GC + CC vs. CC

3) PP + GC + CC with in-application upgrade messages pushing insta-gratification CC-based upgrades vs. plain PP + GC + CC with in-application upgrade messages dumping them to the purchasing page like I have done for the last 3 years

n.b. These are my results but they may not be your results. It is entirely possible my credit card form design (which I flagrantly stole from Twitter Bootstrap) is just bad, depressing CC signups, or the UX disimprovement crushed the favored-payment-method improvement, or something else entirely. Test test test.

Are you measuring, for this specific AB test, the number of conversions? Revenue? Profit? (Admittedly they should all trend in the same direction with the exception of profit, which might depend on how well each company's imposed costs work for your situation.)

Number of sales. BCC (almost) always sells for $29.95, and the difference between the three in processing costs is rounding error.

I didn't understand "a push" at first : It's a blackjack term : "In the case of a tied score, known as 'push' or 'standoff', bets are normally returned without adjustment; however, a blackjack beats any hand which is not a blackjack, even with value 21. Blackjack vs. blackjack is a push."

How was your experience all-in-all?

Reply on news.ycombinator.com