Consider Clement Attlee, possibly the most influential PM of the 20th century (yes, even more so than Churchill or Thatcher) was fabulously uncharismatic being described by Thatcher as "all substance and no show":
http://www.dailymail.co.uk/debate/article-1194059/A-giant-ma...