With the number of qubits required to break RSA, there's no reason why general purpose computing wouldn't be possible.
As a parallel, on a purely theoretical level, we know how to construct a warp drive as well[1].
Solving a theoretical equation is one thing, replicating the prerequisite conditions experimentally is another entirely. Theoretically you can balance a perfect sphere upon another perfect sphere. In practice, you can't because setting up such an arrangement is practically impossible.