Nor do they have to. Inference from different users is batched together.