Ask HN: What do you use for job scheduling?

Hi all,

I’m looking for a good job scheduler solution that fits my use case. In the past I have used the following:

  - Cron
  - SOS JobScheduler (http://www.sos-berlin.com/modules/cjaycontent/index.php?id=osource_scheduler_introduction_en.htm)
  - Celery with Celery Beat

All of these have pros and cons. None of these have satisfied the requirements that I have below, so I find myself building workarounds. SOS JobScheduler is the closest to meeting my requirements.

I’m curious what the standard tools for job scheduling are that people are using in production?

Here are my requirements:

  - Start a job at a given time
  - Start a job at a given interval (e.g. every 15 minutes)
  - Start a job on event:
    - Successful completion of prior job (e.g. a dependency)
    - Successful completion of multiple prior jobs
    - Failure of prior job
    - Keep all stderr and stdout for review
    - Track job run time (e.g. are my jobs getting slower?)
    - Alert on failure
    - Retry job

I would love to hear from the HN community what technologies you are using and how you like them / pros and cons.