You just have to put it away. If it's a tool, treat it like a tool. You don't carry a hammer in your pocket all day.
No, it doesn't; it's you who carves to escape into the phone. I wish it would call me sometimes to at least remember to keep it charged.
And many people do carry a pocket knife or multitool in their pocket all day.
Removing the phone is treating the symptoms instead of the issue.
Anyone unclear on this should read some of the research about phone proximity and cognitive impairment. https://www.dataquest.io/blog/phone-proximity-effect/
Obviously it's actually your brain doing the calling, not the phone, but the effect is the same: it has an effect on you just by existing that you cannot control. It has nothing to do with notifications settings.
I think these kids have the right idea, going back to a flip phone. (Or maybe the modern variant: go Apple-watch only.)