I suppose you could hand-craft some of the script-generated responses if you want.

Why not use GPT-3 or some other GAN and train it on stuff you have actually written?

Then you can have high-quality, automated data to feed the metrics machine.

this, but unironically