iOS does voice recognition on audio without the red bar for microphone being on,
so the active app has access to the text of what's being spoken around it
The way I understand it, an iOS device does always listen for "Siri", but that's done in isolated hardware that an app has no access to.
The orange "microphone" dot does show when it hears your "Siri" command, as well as when an app with microphone permission is listening. (Checked on an iPhone 13, iOS 18).
Nor would I trust that the hardware only ever listens for Siri.