It’s a good point, and I think the age of consent is varied by state and country for just this reason.
- Jessica Alba - Leo DiCaprio - Ben Afleck - Ryan Reynolds - Selena Gomez - Ryan Gosling - Justin Timberlake - Julia Stiles - Elijah Wood - Lacey Chabert - Emma Watson - Joseph Gordon-Levitt - Neil Patrick Harris - Natalie Portman - Hayden Christensen - Ethan Hawke - Anna Paquin - Fergie - Kenan Thomson - Nick Canon - Scarlett Johansson - Jodie Foster - Christian Bale
IMDB lists 31.4 million actors and 20.3 million actresses. I don't think your short list of actors says much about the whole range of experiences.
And you think your even more anecdotal and even more vague "I haven't heard many positive stories from former child actors who talk about their experiences" does?