Setting such a precedent would make an utter mockery of the 4th amendment.
The “Fruit of the Poisonous Tree” doctrine [0] would disagree with you.
[0] https://en.m.wikipedia.org/wiki/Fruit_of_the_poisonous_tree
If evidence is false or tampered with then by all means ignore it, but if it's solid it doesn't matter if it came out just because someone committed some additional crime.