Are you sure your phone microphone isn't always on? At the very least your voice assistant is listening all the time to detect the trigger word (does this send the voice to the cloud for AI assisted detection?). Also if you search for articles about Ultrasonic Beacons, they imply adware tech is listening all the time too.