Contributor will replace ads from AdSense (ads you see on independent publisher sites), not AdWords (ads on Google result pages). They're separate networks.
I suspected that might be the case, which is why I asked. That's unfortunate, but with further information it looks like the search result ads displayed is highly dependent on whether they think your search was commercial in nature, so I guess I'll see how much it affects me in practice.