Having had the same experience at my work (but from the other side), they possibly don't think you are crazy but would just like you to shut the fuck up.
"Corporate accounts payable, Nina speaking. Just a moment."
This is entirely different since the person speaking your example has to speak that out loud as part of their job. Talking out loud to Siri or Google is absolutely not necessary in an office setting. Both are annoying, but only one is avoidable (and thus rude).