This happens distressingly often in LLM demos. Significant errors being papered over because people are so enthralled by the "look Ma, no hands!" effect. Just got out of a work meeting where the exact same thing happened with an internal chatGPT integration.