_8lib

Yep, an API is definitely on the roadmap as well. :)

It's better having 1 page from an SEO perspective.

Yep, automatic testing will be coming soon! :)

Yep, automatic testing is definitely on the roadmap!

Hey there! Thanks for the congrats. I see your point, but external factors + different cohorts visting throughout the test is a bit of a pickle. Nonetheless, I wish you the best!

tldr; Pricing is painful. Most companies leave it to chance and there's a real opportunity here to change that.

All great points. Data significance + education on how it works is super important here (and something I've been personally explaining to many brands and merchants).

Another thing I'd like to add: most of the comments in this thread are assuming price is going to be increased when in reality a good number of merchants are going to actually end up lowering their prices (and serving more customers). In the end, it's all about delivering + capturing as much value as possible.

Yep, going to do all online pricing.

This is what I applied with.

Thanks for the suggestion! Contribution margin/profit is another metric we're going to track in the future for sure.

1. Using random id + localstorage, so yes, incognito could result in a different price.

2. I'd love to implement MAB, but focused on nailing core product for now.

Re point 1: in many cases people actually DO have the sample size if the magnitude of the revenue increase is large enough (e.g. double price and increase conversions - lots of stories about this).

Re point 2: in the end increased revenue from better pricing means you're capturing more of the value you're delivering to customers. but yes, there's a brand decision to be made here between 1 price that you always keep the same vs. a changing price that is more optimal.

Re point 3: companies should always be testing their pricing since external factors don't stay the same.

PS: this is also on the blog of a dynamic pricing company so they don't want the people on the fence about handing over pricing control thinking about a/b testing price haha.

Yeah, it's a tradeoff for sure. I would say discounts that don't apply to everyone are a less organized way of a/b testing price. So a brand that does discounts all the time on certain cohorts of their users is going to have an easier time swapping over to using [name-redacted] vs. a brand that has 1 price, no discounts ever, never have changed their price.

Addressed this a bit in another comment, but if you think about it, non-public/targeted discounts are pretty much unorganized price a/b testing. Also, the alternative is having sub-optimal pricing which isn't going to cut it pretty soon with Amazon (+ other big companies) dynamic pricing tech + in-house brand expansion.

Unfortunately this wouldn't be a proper a/b test since it'd be comparing 1 day of 1 price to another day of 1 price. Only by splitting traffic 50/50 do you properly isolate the price variable.

Yeah, someone could totally build Honey for [name-redacted] if they really wanted to here haha. If you think about it, discounts that don't apply to everyone (what Honey targets) are pretty much unorganized price a/b testing.

Thanks Jason!

Depends on the magnitude of the revenue increase.

One thing that inspired me to build [name-redacted] were the stories of sellers doubling their price and actually increasing their number of conversions. I haven't had a customer like that yet, but I had one person who reduced their price 30% and increased their conversions 5x+. In that case, it's pretty clear there's a winner.

Thanks! Keeping things simple + self-explanatory is a big focus with [name-redacted].

Neat A/B is a 100% daily traffic swap app. This approach isn't a valid a/b test since it isn't properly isolating the variable (price).

Awesome, feel free to email me at [email-redacted] when you get started and I'll personally onboard you if you'd like! And in terms of optimizing, I think the biggest shift for me was keeping everything I want to do in a list (Google Doc ha) and building momentum by doing the easy things.