Do not enable channel notifications. Only direct messages and perhaps for some specific channels that you care about.