But why is FSD "failing" is the key question.

Hint: it's not the sensor inputs that are the bottleneck!