Do you think that computer science was impossible before the construction of computers?
Furthermore, the bifurcation of computer science and electrical engineering hasn't been all that successful as an academic practice. UC Berkeley recently decided to leave the ABET accreditation process for EECS because they felt they can innovate on a better synthesis of the fields for the fields and students.
And similarly, studying QC in the theoretical form can also lead to discovery and understanding of quantum properties. Even if we have no fully-featured quantum computers.
Computer science and the construction of computers are virtually the same thing. Making a computer was never a challenge; making a faster computer always is.