We've been happy using Thompson sampling in production with this library https://github.com/bayesianbandits/bayesianbandits