By my honestly shallow understanding of cancer it's not that simple.
For the cancer to not get killed immediately several things have to get broken, not just the replication inhibitor. Once they get to that state is not far fetched to think that they can have or get in the future different mutations, not specifically required to get cancer in the first place.
The comments below us talk about the folate receptor mutation that not all cancers have.