You also need to take into account user annoyance, would you rather show a 10$ ad today, but lose the user and never show another ad or show a 2$ ad every month until eoy. There's a lot more than just revenue that factors into these algorithms. And you also need to take into account advertiser's ROI, they want people who will convert.

Source: used to work on prediction modelling in ads.