That's a good point. FB/Meta did a blog post talking about the tech. There are some failure examples there:

https://ai.facebook.com/blog/using-ai-to-bring-childrens-dra...