If you're in Europe, I saw quite a few comments here saying that banks not requiring the duopoly do exist. Otherwise, a dedicated banking phone might be the way.