Remove duplicates in large datasets

potentialmind.wordpress.com