That is not Apple’s only application of facial recognition: https://support.apple.com/en-ca/guide/photos/phtad9d981ab/ma...
Maybe it's changed, but I think that if you get a new device, it basically has to reindex all the faces iirc. Or maybe it's only stored in your own personal iCloud.