Cribbing from a famous quote: this interview methodology is the worst except for all of the others. We don't know what a systemic, better interviewing system would be.
Perhaps the answer is that there is no systematic interviewing system that actually works well. It seems like trying to create one was the origin of all this pain, and the cargo-culting by companies that don't need a systematic process has amplified it.
Interviewing is an inherently social, inherently subjective process. Such things are highly resistant to systematic approaches.