You can't browse, play interesting games, you can't doomscroll, you literally can't do any of the addictive or distracting things that phones are notorious for.
If you happen to have full notifications on for slack/Facebook/etc yeah it can get annoying - but you can't really immerse yourself in it.
I think of the watch as a pure comms/notification device whereas the "phone" has become a full-on handheld computer.