Always replied in Portuguese for me if requested, with a weird English accent to be fair. It seems whisper will transcribe everything you say (translated if needed) into just one language, usually English, if you mix them. This is with GPT4 though.
It replies in the language it thinks follows from what you said. It may have detected that you're non-English languages sounded like an English speaker?
It understands more languages than it speaks, so no it does not always reply in the same language.