What are you guys using for durable queues? I'm currently evaluating Redis and RabbitMQ.
Scaling RabbitMQ at SoundCloud: http://vimeo.com/69960105
Edit: usually with durable queues on SSDs
Edit: text version of the talk: http://blog.pivotal.io/pivotal/case-studies-2/scaling-with-r...
What is it about RabbitMQ or Redis durability that you find lacking? What alternative do you recommend?
http://aphyr.com/posts/315-call-me-maybe-rabbitmq
But all systems like this have weak points, just look at the other systems aphyr has analyzed.
http://aphyr.com/posts/293-call-me-maybe-kafka
We chose RabbitMQ, but we're achieving durability by storing messages in a backup database (CouchBase) that appears to handle partitions better. Still not ideal, and more complicated than we'd like.