Thanks for the comment. The third blog post in this series will discuss linear contextual bandits, for which I used Langford's VW.
It does a huge amount better.
156 karma · joined July 3, 2012
It does a huge amount better.
And for intervals: yup, we just use sampling. But it's super fast because all you need are independent samples. For more details, see this first post: