An example: this same model colorized the Golden Gate white: https://camo.githubusercontent.com/3487a03626fd86d4f8c814636...
In my case I wasn't too concerned, since I was sharing the photos with my family, who understood they were artificially colorized. My father even asked me if it was possible to choose specific colours in articles of clothing, since it got those wrong. Nonetheless, to me and my family, it made our old photographs seem so close and alive, which made it worth it.
A good compromise may be to mark these retouched photos with a small watermark indicating that they have been altered. By the way, I think the colab instances running this model have the option to add watermarks for this reason (https://colab.research.google.com/github/jantic/DeOldify/blo...).