I would object, I want my containers to be as fast as possible and the JIT compiles for each CPU arch you run it on (supposedly optimally). Docker image size, who cares?

Even that depends. If you use two or more images based on same ie. official .NET image, you have only one .NET image and total images size might be lower.