I can distinguish the icons of every site I visit on a semi-regular basis.
Having only icons would be such an accessibility disaster.
How useful to you is an unfamiliar favicon, or a row of tabs with an assortment of unfamiliar favicons?
That it actually quite useful when I flick back to a random browser window after being distracted... ("Ahhh, that's my timewasting window!")