Unless you deactivated Siri or Ok Google your phone is definitively listening to you and people around you.
The audio isn't leaving the phone but a text transcript probably is.
I don't trust closed source software owned by quasi monopolies to do the right thing instead of what will maximize their profits / control over users.