Could your performance problems be closer related to http://news.rapgenius.com/James-somers-herokus-ugly-secret-a... than the performance of Django or your code?
Heroku has always been great for us!
I'm always a bit surprised about the RapGenius stuff because their problem is not really a Heroku specific issue, IMO. If you're running code on Heroku (which uses random load balancing), you need to have a proper multi-threaded web server to serve requests concurrently.
In our situation, we were able to service many concurrent requests per dyno, and maintained very low response times (10ms or less), in most cases.