My overall impressions with message brokers is that RabbitMQ is a pain in the ass to setup, celery is my go to these days with beanstalkd being a close second if I don't want too many of celery's features.
My overall impressions with message brokers is that RabbitMQ is a pain in the ass to setup, celery is my go to these days with beanstalkd being a close second if I don't want too many of celery's features.
RabbitMQ's problem is that has no tolerance for network partitions, and also tends to be very buggy in the presence of such.
There are client drivers for a wide range of languages including Python and Ruby (and also a ActiveJob compatible library).
Installing it is simple as downloading the source, running make and then the binary. http://kr.github.io/beanstalkd/
I do agree there's a few gotchas with clustering though, such as firewall rules and inet_dist_listen_min/max, setcookie, etc.
1) sudo apt-get install rabbitmq 2) there is no step 2
Somehow, I found Kafka easier to use than RabbitMQ.