"I would like to make a confession which may seem immoral: I do not believe absolutely in Hilbert space anymore." - John von Neumann
But then again, he was John von Neumann.
For example, in the Unruh effect an inertial observer sees the vacuum in their Hilbert space as having no particles. However, a uniformly accelerating observer sees that same vacuum as containing particles.
This state of affairs is addressed via algebraic quantum field theory (AQFT), which doesn't take a Hilbert space as the primary thing one starts with, but views Hilbert spaces as derived concepts.