You'll also have to do 'bundle update <broken-gem>', commit the resulting Gemfile.lock and hopefully wait for your CI build to pass before deploying. Doing that 15 times would be onerous.