Only in Gemfile.lock. If you've hard-coded a version in Gemfile, you'll need to update it.
Eg. These will update fine:
gem "rails"
gem "rails", "~> 3.2"
This wont: gem "rails", "= 3.2.10"