I makes a lot of sense to me, who have been doing this for over a decade with my friends.
Are you busy, don't join / mute yourself / go to the afk channel.
Are you waiting for a long build, just reading HN, between tasks? Join the channel and people can bond and talk about work/life.