IDK, if you want to run WebGL games you probably don't use IE anyway.
Niche / hardcore game developers can potentially ignore this but if you are going for mass market you really can't.
As a web developer at a creative agency, it's impossible to pitch an interactive 3D simulation or data visualization project to a client if it won't work in IE. I'd be happy if even CSS 3D transforms were widely supported.