This has a really good overview of the Multi-Armed bandit approach as it applies to testing and optimizations https://support.google.com/analytics/answer/2844870?hl=en