He also started all the things that are happening now, including Azure, Office 365, Surface, and apps on iOS and Android. Yes, even putting stuff into open source.
You could also write a long list of things Ballmer got wrong. However, that's true of all tech CEOs, including the various CEOs of IBM, HP, Dell and Sun, among others.
It was clear that he thought that part of his role as CEO was to be the chief cheerleader for Microsoft. Hence the high-energy appearances at the annual meeting, the scoffing at competitors, the bombastic interviews, etc.
What Microsoft probably needed more was a tough critic--someone who could impose upon the company a set of standards and demands that would keep them from becoming too complacent. That's how Bill Gates saw himself. He kept a Mac in his office while they were working on Windows just so he could torment his dev team with the comparison.
Under Ballmer, Microsoft missed the rise of search, missed the rise of open source, missed the rise of social media, and missed the rise of mobile--despite having solid technology and marketshare early in each of those instances.