I am a PhD student in physics and I would definitely say that linear algebra is more important.

I think most would say that functional analysis is a generalization of linear algebra and that you absolutely need your linear algebra first. (Functional analysis is often thought of as infinite dimensional linear algebra.) Moreover, (finite dimensional) linear algebra is sufficient for learning theoretical quantum computing where there is a finite number of states.