The robin example applies to BERT, not GPT-3.
With GPT-3, here are a couple generations I got for "A robin is not a":
A robin is not a bird of a thousand feathers. It is a bird of a thousand songs. – Lebanese Proverb
A robin is not a bird of prey and cannot eat a pigeon. I've never seen a robin kill one of those.