The elephant in the room is voter fraud. If we switch to raw vote count then it takes just one loosely regulated precinct to flood the election with fraudulent votes to win the election, and anyone can do this. Sure, this time around one group may win the fraud vote, but next time it will be another group, and the the best fraudsters will conspire to run the country and we will cease to be a democracy and become a kleptocracy. At least with the electoral college the fraud has to be much better organized and spread more across the country.