Ignoring solid evidence just because it was acquired illegally is mockery of justice, logic and common sense. If it was collected illegally then punish the person that did the illegal thing but do not discard the evidence.
The “Fruit of the Poisonous Tree” doctrine [0] would disagree with you.
[0] https://en.m.wikipedia.org/wiki/Fruit_of_the_poisonous_tree
If evidence is false or tampered with then by all means ignore it, but if it's solid it doesn't matter if it came out just because someone committed some additional crime.