Using plain svgs nowadays, never looked back.
Some of the icons themselves represent something of a universal language for websites. Using those symbols in a typeface is similar in some ways to character based languages like Japanese or Chinese. So I might argue that icons as fonts are quite an appropriate use.
But then there was IE9 mobile, which didn't support @font-face. I remember coding detection for that, and creating a script that automatically generates png versions and the required CSS of the glyphs in use. Sigh.