Well there's a reason there are safeguards agreements and inspections. The idea is a slow mutual drawdown and then eventually a rapid final disarmament once a critical low threshold is reached.
You can maintain the safeguards and inspections indefinitely via the IAEA.