My goal with this article is only to help readers who have wondered how time-domain approaches like Kalman filtering relate to frequency-domain approaches like low-pass filtering, and to connect those dots. It's not a comprehensive article about the magic of Kalman filters.
I would contest that the reason a frequency filter doesn't work on a gyroscope is not because it's a MIMO system (which frequency domain techniques can generalize to; you just end up with n x m transfer functions) but because the system is not static, so it doesn't satisfy the conditions that would cause the Kalman filter to converge to a fixed-coefficient filter.
The MIMO distinction is also not super important. Since you can also have MIMO low pass filters. The real difficulty is obtaining the coefficients of these filters and hopefully find the best ones. That's where you start getting into the optimality and the real contribution of these tools. But as a side-effect you must assume that the noise is Gaussian otherwise you lose much of the niceties of the theoretical guarantees. This is basically the biggest control theoretical disadvantage of kalman filters and the reason why other domains keep rediscovering it while in control it is "kinda, sorta" falling out of grace.
in fact, in the static case, a kalman filter is exactly the same as the recursive least squares estimator, which is provably the optimal unbiased estimator
But the overall subject of comparison to just a low pass filter is very interesting
In one of my other articles where I applied the Kalman filter to a more complex system, a frequency-domain filter would have failed. But in this article I tried to stick to the simplest possible system, so that the math wouldn't get in the way of illustrating the way in which Kalman and Wiener filters relate to each other, since it's an interesting connection that doesn't get much attention.
So, when the quality of measurements is very high (almost no noise), then the motion model provides very little benefit. And when the measurement quality is very low, the motion model reduces the error ellipse around the real state of the system.
So, even when there are inputs and a motion model you could imagine the Kalman Filter as a frequency-domain filter (E.G. IIR/FIR filter), where the tap weights are being updated based on some known function.
If the quality of the measurements are high enough, and the sampling frequency is high enough. Then the Kalman filter should be able to converge to a very good estimate of state, even with no motion model right? In which case it would have the exact same characteristics as an adaptive, slowly time-varying frequency-domain filter.
No. Consider this discrete-time linear system with 2-dimensional state [x1, x2] and one output y:
x1' = 2 * x1
x2' = x2
y = x1 + x2
Suppose we see the output sequence 1, 2, 4, 8, ... If we know the motion model, then we know that the initial state must have been [1, 0]. (In technical terms, the pair (A, C) is observable.) But if we don't have the motion model -- all we know is that y = x1 + x2 -- there's no hope of ever getting a state estimate, even if our y measurement has zero noise.