In France, we have something called "droit à l'image". It means that if you can't appear on a picture without your authorization, with a few exceptions.

If you give an authorization, it has to be for a specific purpose and not generalized. So just because you gave an authorization to appear in a movie doesn’t mean you gave an authorization for other purposes, such as face matching. Same thing for social media.

There are also copyright issues. If France, you always own copyright (droit d'auteur), you may transfer the exploitation rights but the work is still yours. It means you still retain some level of control, in particular regarding decency.

France is just one European country but that's to show that there are limits to what you can do, even with publicly available data.