> What I'm still looking for is what exactly he did that drove the people away?
I have a personal policy to try to support horrible people as little as possible. Elon is a horrible person[1] and having a Twitter account means supporting him financially and through his power over the platform. Deleting my Twitter account was not a big hardship for me, so that's what I did.
[1] e.g. https://news.ycombinator.com/item?id=38882249 plus his support for anti-trans policies & politicians.