Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later. Queues are picked off in order of their priority. A job from a lower priority queue will only be picked off if there are no jobs for a higher priority queue available.

Resque -  Job queue in Ruby 

Fireworq is a lightweight, high-performance job queue system with the following abilities. It is available from ANY programming language which can talk HTTP. It works with a single binary without external dependencies. It is built on top of RDBMS (MySQL), so that jobs won't be lost even if the job queue process dies. You can apply an ordinary replication scheme to the underlying DB for the reliability of the DB itself.
<BR><BR>
It supports primary/backup nodes. Only one node becomes primary simultaneously and the others become backup nodes. A backup node will automatically be active when the primary node dies. It always works with a single dispatcher per queue which can concurrently dispatch jobs to workers via HTTP. Scalability of workers themselves should be maintained by a load balancer in the ordinary way. This means that adding a worker will never harm performance of grabbing jobs from a queue.

Fireworq is a lightweight, high-performance job queue system with the following abilities. It is available from ANY programming language which can talk HTTP. It works with a single binary without external dependencies. It is built on top of RDBMS (MySQL), so that jobs won't be lost even if the job queue process dies. You can apply an ordinary replication scheme to the underlying DB for the reliability of the DB itself.

Fireworq - Lightweight, high-performance, language-independent job queue system

Delayed_job (or DJ) encapsulates the common pattern of asynchronously executing longer tasks in the background. It is a direct extraction from Shopify where the job table is responsible for a multitude of core tasks.

delayed_job - Database backed asynchronous priority queue

Simple, efficient background processing for Ruby. Sidekiq uses threads to handle many jobs at the same time in the same process. It does not require Rails but will integrate tightly with Rails 3/4 to make background processing dead simple. Sidekiq uses multithreading so it is much more memory efficient than Resque (which forks a new process for every job). 

Sidekiq - Simple, efficient background processing for Ruby

The fastest, most reliable, Redis-based queue for Node. Carefully written for rock solid stability and atomicity. 
<ul>
<li> Minimal CPU usage due to a polling-free design.</li>
<li> Robust design based on Redis.</li>
<li> Delayed jobs.</li>
<li> Schedule and repeat jobs according to a cron specification.</li>
<li> Rate limiter for jobs.</li>
<li> Retries.</li>
<li> Priority.</li>
<li> Concurrency.</li>
<li> Pause/resume—globally or locally.</li>
<li> Multiple job types per queue.</li>
<li> Threaded (sandboxed) processing functions.</li>
<li> Automatic recovery from process crashes.</li>
</ul>

The fastest, most reliable, Redis-based queue for Node. Carefully written for rock solid stability and atomicity. 

Bull - Premium package for handling jobs and messages in NodeJS

Agenda is a light-weight job scheduling library for Node.js. It aims to keep its code base small. It is  backed by Mongo backed persistence layer. It supports scheduling with configurable priority, concurrency, repeating and persistence of job results, Scheduling via cron or human readable syntax, Event backed job queue that you can hook into.

Agenda - Lightweight job scheduling for Node.js

Pyres is a Resque clone. Resque is a great implementation of a job queue by the people at github. 

Pyres - Job queue in Python

goworker is a Go-based background worker that runs 10 to 100,000* times faster than Ruby-based workers. goworker is compatible with Resque, so you can push your jobs with Rails and Resque, and consume them with Go in the background

goworker - Go-based background worker

Jesque is an implementation of Resque in Java. It is fully-interoperable with the Ruby and Node.js (Coffee-Resque) implementations.

Jesque - Job queue in Java

A simple, fast, robust job/task queue for Node.js, backed by Redis.Bee-Queue is meant to power a distributed worker pool and was built with short, real-time jobs in mind. A web server can enqueue a job, wait for a worker process to complete it, and return its results within an HTTP request. Scaling is as simple as running more workers.

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

Kue is a priority job queue backed by redis, built for node.js.
<ul>
<li>Delayed jobs</li>
<li>Distribution of parallel work load</li>
<li>Job event and progress pubsub</li>
<li>Job TTL</li>
<li>Optional retries with backoff</li>
<li>Graceful workers shutdown</li>
<li>Full-text search capabilities</li>
<li>RESTful JSON API</li>
<li>Rich integrated UI</li>
<li>Infinite scrolling</li>
<li>UI progress indication</li>
<li>Job specific logging</li>
<li>Powered by Redis</li>
</ul>

Kue is a priority job queue backed by redis, built for node.js.

Kue - Priority job queue backed by redis, built for node.js

Discover open source projects across all platforms

Projects

Resque - Job queue in Ruby