I think Google needs to be really careful with this. It would make sense that the first place they should look for over optimization is anchor text manipulation. The problem is that this could open up the door for "Negative SEO" services where you can blast a competitor with high traffic keyword anchor texts. The safest place to look will be on page factors and if they decide to go after anchor text manipulation there should be some type of authority metric that protects established sites.