I specifically asked Google rep on that point and he said penalty would still apply.
One G product can affect another it seems.
It is worth bearing in mind that not all sites are reliant on google traffic, so more cash from Adsense at a hit on ranking may mean more £ and zero traffic impact.