The linked blog post covers this, and the improvements made to make the new dedup better.