I strongly disagree. If you can't be bothered to write resilient code, that's your choice, but don't speak for me on what I should and shouldn't support.
Supporting IE !== "writing resilient code"
If anything your code will be much worse for it and likely to contain more bugs.
Your code could also just be simpler and not include bug-prone ways of writing.
For each browser you add support for, x more browsers and access limitations you've never even heard of also become supported.
At 2.3% in Japan, and a much higher percentage in some specific industries there like healthcare, some people probably might be bothered supporting IE. Not me or most people though: