I tried this, but had the opposite problem. With push notifications turned off, I constantly feel the urge to check the app to see if there’s anything new. With them turned on it’s easier to ignore the app unless someone actually messages me.