This is exactly what Taleb wrote about [1].

Systems start out very fragile. Over time they get more and more robust, as edge cases and events result in more rules and rigidity. This works until they become so robust that they can no longer cope with the change when something unexpected -i.e. a black swan event - happens.

The only way to counter this, to make a system that improves in coping with disorder/chaos as it encounters it.

[1] https://en.wikipedia.org/wiki/Antifragility

Update: reworded that last sentence a bit.