What other data do we discard? Who gets to decide which data to discard? There is no point in doing data analysis if you then discard uncomfortable data anyways.
Discarding evidence isn't a new concept, it's a well established and very import part of our existing judicial system. Lady Justice doesn't wear a blindfold as a fashion accessory. Google "fruit of the poisonous tree" to learn about the specifics.