I suspect that a lot of the anxiety about how difficult it would be to quit is the mind's way of rationalizing a psychological addiction, like saying you can't stop smoking because things are just so crazy right now.
I quit social networks in 2008, it wasn't hard at the time and it's not been hard to stay away. Yes, there are consequences of being the one guy in the friend group who doesn't use whatever app everyone else is using, but to call those consequences meaningful is an overstatement. A minor annoyance, easy for everyone to adapt to.
You're right that other people are still influenced by social networks. Speaking from the outside, I wouldn't even use the word 'subtle' to describe its effects. But, I don't know that that really matters. You surround yourself with people you like, despite their flaws. You hope the good things about them grow, and that they work through their flaws. That's just having friends.