Subject to regulations, banks take all types of precautions to identify you. Would not regulation force them to comply with how can you identify your bank in one of these touchpoints?
My best suggestion would be to have something like reverse 2FA in the mobile banking app: the calling agent should be able to tell you the number you are seeing in a specific screen on your phone app.