There is no evidence of a company using the fact that you've said "yes" at a random point in the conversation as confirmation that you've agreed to their (maybe unheard) pitch, despite variations on that urban legend doing the rounds for years.
https://www.snopes.com/fact-check/can-you-hear-me-scam/
https://en.wikipedia.org/wiki/Can_you_hear_me%3F_(alleged_te...