"Stories have fallen off the front page sharply despite doing well" is an instance of flagging overcompensation, not punishment for vote rigging.
Also, some domains have been penalized, which is why some articles fail to make the front page even with many votes on r/newest (e.g. medium.com)