Is this not just something MS Teams did? [1] You seem to be implying it's an optional setting or customization. I'm not an MS Teams admin, just a user on one instance of Teams, and was happy when the button appeared.
It stopped the broken conversations, but it didn't make anyone use MS Teams any more than necessary. (Our group has been using Slack for longer than Teams has been around, and since Teams is still inferior in nearly every way we haven't switched; due to the near silence from every other org in the company, they're probably doing the same).
[1] https://stitchdx.com/blog/microsoft-teams-new-conversation-b...