Man, this debate is both very interesting and highly confusing with different people oscillating between "It's just a tool" and "It's a human being+"
That's not even close to true!
Even if you've been living under a rock for the last 5 years and didn't already know these models are not reliable, pretty much every provider has a disclaimer next to the chat box informing you of that fact.