Using machine learning to estimate lost demand in a fulfillment chain
tech.instacart.com
tech.instacart.com
Anybody who's interested in this should read up on the Kaplan-Meier estimator (https://en.wikipedia.org/wiki/Kaplan%E2%80%93Meier_estimator). If you want to see it used for a problem that's very similar to demand estimation, see Censored Exploration and the Dark Pool Problem (https://www.cis.upenn.edu/~mkearns/papers/darkpools-final.pd...).
Throwing the machine learning label into the mix always pushes the expected results to a higher standard.
The authors in this article do not show any ML, its all mainline stats.
ML is used, even in these areas, for the things it does best. So it is a misnomer to separate nowadays.
But i disagree that one wozld expect ML to do better in this area.
Look at websites doing ab testing, which is certainly not ML but experimental stats.
Their particular causal inference approach appears to be simply outcome modeling, which is an OK approach (the main problem with it is that it doesn't provide good diagnostics for detecting violation of your strong ignorability assumptions necessary for the procedure to work). They could probably improve things a bit by using a doubly robust estimator.
Kaplan-Meier estimators are completely irrelevant. Those have to do with right censoring of survival distributions.
[1] https://www.kdd.org/kdd2018/accepted-papers/view/customized-...
While there was clearly a negative experience for the customers who went through the experiment and had appointments rescheduled, we did get a very good measure of true demand and were able to optimize some of our supply dynamics.