* IRC users have the technical acumen to move.
* IRC users aren't strangers to setting things up and configuring them, so the switching cost isn't as big
* There's a shared ethos about IRC, but not so much for an app that reaches everybody on the planet. You can convince one demographic much easier than all of them.
* IRC is interoperable and easy to change servers, unlike apps with proprietary protocols. If Yahoo started doing horrible things with their email, then people who notice would switch to GMail or another host.
For example the SerenityOS project used to advertise on their site that they had a channel on freenode but now they link a Discord instead.
Non-technical users have the same sort of experience e.g. switching cell phone providers (provided your area has number portability), switching between subreddits, etc., and those moves definitely happen.