IE 10 (and to a lesser extent, 11) has really wonky support. In a self-contained SVG, it's fine. Once you need it to scale a certain way, you'll find things get weird.
IE 10 basically dropped off the face of the earth, but 11 is stubbornly hanging on. Still, if you're optimizing the size of SVG bytes for the benefit of these browsers, you're likely to add that weight right back in with all the IE-specific CSS you're likely to add in.