>I think the biggest difference in time was given by the "attacker" trying to understand what the FaceID system is looking for exactly, as an algorithm. But once they know that, future attacks should be much faster

Not necessarily, as the algorithm is a NN (IIRC), so it looks for different things on different people too.