I think that a combination of both works well also, especially if the icon enhances the meaning of the text and the text enhances the meaning of the icon.
Where the whole icon thing sort of works, is with tools where the words won’t be able to communicate what a tool means anyways and. when there are too much for (e.g. the tools in photoshop)