It’s generally easier to carry the conversation to its natural conclusion — people tend to respond inordinately negatively to being bluntly told when others are not interested in a conversation.
As to your last question, the “why” is simple. I find small talk to be both pointless and exhausting. I prefer to be left alone, and for those with nothing to say to say nothing.