We've used this Python package to do this: https://github.com/bayesianbandits/bayesianbandits