If another human is attacking you with intent to kill and you have no other options? How about in a case like the trolley problem [1] where you are forced into a challenge of scale? These are all valid problems with designing current engineering systems, not just AI systems.
It's possible to philosophically "bite the bullet"[2] and say "No, it's never justified or moral" however that doesn't pass the test of practicality.
So, something as seemingly obvious as "Don't kill" doesn't have firm boundaries which we can create a universal set of mathematically implementable, and acceptable, rules for.
[1]https://en.wikipedia.org/wiki/Trolley_problem
[2]https://en.wikipedia.org/wiki/Bite_the_bullet#In_philosophy