Thank you for this comment!

I haven't spent much time learning about how ChatGPT works, but:

'ChatGPT does not simply output the “most semantically popular result”. That description applies only to the base model, before instruction tuning and RLHF.'

was exactly the explanation I needed!