An ABM system can be developed surreptitiously; it wouldn't be easy to distinguish ordinary research launches from ABM test launches, or to distinguish ABMs from other kinds of air-defense missile. Patriots, for example, are supposedly able to defend against ballistic missiles.
If you can't detect another state developing ABM systems, then the treaty becomes unenforceable, and is a destabilising factor.