Physicists would have preferred to do it with calculus -indeed, intro QM is usually taught with calculus, not with linear algebra. But you can't go very far without talking about operators and eigenstates. Linear algebra fits the underlying physical phenomenon. People have tried to develop nonlinear versions of quantum mechanics, with no success so far. In particular, if quantum mechanics was not exactly linear, then a quantum computer would be able to solve NP-complete problems in polynomial time!
To get an intuition of why quantum mechanics looks the way it does, Scott Aaronson is extremely helpful: https://www.scottaaronson.com/democritus/lec9.html