I think most people want to talk and have only the person they are talking to listen.
IDK about you but most of the shit I say, I'd be happy for the hearer's assistant to be listening and potentially adding the things we agreed on to their to-do lists or calendars.