On the one hand, term limits are deliberately eroded by long-running despots (primarily in some African countries so far, and increasingly elsewhere in the world lately.) On the other hand, Germany's chansellorship does not, IIRC, have term limits and that seems to work fine for them. So maybe being able to remove term limits is a symptom more than a cause?
Either way, questions like these are discussed in the book How Democracies Die, which has been recommended to me and is on my re-read list, but which I haven't gotten to yet.