We used to have this problem, but I think Slack added a feature to fix this. Our general room is now locked so that people can't post into it, but everyone is still a member.