Are they cannibalistic? If so, problem solved. If not, their progeny die because they've solved the silverfish problem and there's no other food.

Kind of a cats and mice thing, was my point.