The existence of this chat proves that llms can respond with "I don't know" if instructed that it has that option.