The only out you would have is to claim that there is something supernatural that separates the fundamental operations of a brain from those of computation, i.e. given an computer the size of the universe, with billions of CPUS and GPUS to simulate each neuron of a brain, that you still would not be able to simulate one. That there is something supernatural that even infinite regular computation could never capture.
If you don't take that stance, then the only line you are drawing between brains and computers is their compute performance for a given task (even if that task is "be conscious").
This is (perhaps) similar to the difference between regular and quantum computers. There is nothing a quantum computer can do that a regular computer can't, the difference is just in their relative performance for given tasks.