iTerm did have at least one rather serious data leaking bug in the past. It was introduced in a new feature and enabled by default.
People (or power users at least) tend to remember incidents like that. I don’t think it’s entirely “just because LLM’s”.