You don't need Git to use RoR ... but try and learn it. It's awesome ;)
Git also comes with a SVN bridge, which works wonderfully for me.
Also ... Rails has its own development web-server. You don't need to have a production environment to learn it.
And I really recommend that when learning about any web framework, in any language ... just learn how to deploy a production server by yourself. It saves a lot of pain later on ;)
Not to mention that I wouldn't use Heroku ... sure they provide a valuable service, but personally I get a cheaper deal by getting EC2 instances and configuring them myself. It's hard the first time, but then you can scale your infrastructure easily ... EC2 is wonderful in that regard.