I don't know if it was spam or all the format changes, each time a format change occurred users complained - a lot, yet changes were implemented anyway.
The highlight of Digg's history I'd say was the HD-DVD encryption key everyone put in posts refusing to back down I think that brought the users together.
Then one day the user-base seemed to suddenly shift rapidly to the right almost overnight from a more centrist point of view, that cause a lot of friction and comment wars.
Telling the people who use your website, some of who practically lived on the website, what they should like and not like design-wise instead of listening to them was disastrous and may have been the cause of Digg.com being abandoned by most of its user-base.