A recent(ly featured on the front page) example where synthetic data is helping solve an unsolved problem:
https://eng.uber.com/generative-teaching-networks/
I'm being pedantic by posting this though, because their approach involved learning the synthetic data generator simultaneously with the classifier/whatever that you're training. That is not relevant for a static synthetic data source.