I don't know about Rails, but as a Symfony2 user, it's actually a bit on the slower side compared to other PHP frameworks.
But ~300ms server response times is nothing if your end user has to wait 5-6 seconds for the page to render due to suboptimal frontend code. Plus, throw in varnish/nginx microcaching and requests drop to ~10ms regardless of your framework.