Ask HN: How do you QA GPT-3 apps?

1 pointcloudking1 comment

If your GPT-3 powered app relies on custom crafted prompts, how do you conduct QA on your app to ensure reliability? It seems like you can get different results for the same prompt, so I'm curious if this is a challenge or not.

View on HN

You would not use the "public" database when you want only your topic covered. When covering your topic, finetune and restrict. also, you can restrict what is given out. There are some samples on the page of them.

Or, one might forward the output of chatgpt to Alexa. If she understand, then QA passed :)

Reply on news.ycombinator.com