Yeah I've been doing much the same, I've given mastodon a pass for now for direct mentions only (which tootdon lets you configure) because those notifications are people's actual interactions with me - whereas with Twitter and Facebook it's generally any old crap that happens to one of my friends or follows, or sometimes even somebody else who some people I know have followed (who cares?!) so that gets turned right off. In fact I don't even have the Facebook app, I just look at it in my browser - sometimes it still manages to sneak a few notifications through Chrome even though I was sure I turned those off.
Mostly it's just very annoying when for some reason my phone doesn't manage to prioritise push messages which come from direct messages or SMS and so they somehow manage to get buried under a honking slew of social media detritus.