Performance has always been a finger in Ruby's eye, but with 1.9 that doesn't seem the case.
Regarding libraries; you are right. Ruby has a lot of code out there, but much of it is in random repositories maintained by random people. Hopefully this changes.