wocc··on Homomorphically encrypted CIFAR-10 inference in 200msagreed. The omission of what bit security they are using is of note and they Key missing component of the overhead equation. Private key is better :)
wocc··on Homomorphically encrypted CIFAR-10 inference in 200msYou're identifying one of the (many) underappreciated cost in the RLWE FHE stack. The evaluation key problem doesn't scale, and no amount of hardware acceleration fixes a per-user storage and loading overhead that grows with the security parameter.