RQ (Redis Queue) is a simple Python library for queueing jobs and processing them in the background with workers. It is backed by Redis and it is designed to have a low barrier to entry. It should be integrated in your web stack easily.RQ requires Redis >= 2.7.0.

rq - Simple job queues for Python

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

Celery - Distributed Task Queue

The fastest, most reliable, Redis-based queue for Node. Carefully written for rock solid stability and atomicity. 
<ul>
<li> Minimal CPU usage due to a polling-free design.</li>
<li> Robust design based on Redis.</li>
<li> Delayed jobs.</li>
<li> Schedule and repeat jobs according to a cron specification.</li>
<li> Rate limiter for jobs.</li>
<li> Retries.</li>
<li> Priority.</li>
<li> Concurrency.</li>
<li> Pause/resume—globally or locally.</li>
<li> Multiple job types per queue.</li>
<li> Threaded (sandboxed) processing functions.</li>
<li> Automatic recovery from process crashes.</li>
</ul>

The fastest, most reliable, Redis-based queue for Node. Carefully written for rock solid stability and atomicity. 

Bull - Premium package for handling jobs and messages in NodeJS

Machinery is an asynchronous task queue/job queue based on distributed message passing.

Machinery - Asynchronous task queue/job queue based on distributed message passing

At a high level, Faktory is a work server. It is the repository for background jobs within your application. Jobs have a type and a set of arguments and are placed into queues for workers to fetch and execute.You can use this server to distribute jobs to one or hundreds of machines. Jobs can be executed with any language by clients using the Faktory API to fetch a job from a queue.
<BR><BR>
Faktory is a server daemon which provides a simple API to produce and consume background jobs. Here's the chatter to create and execute a background job. Jobs are a small JSON hash with a few mandatory keys. Producers PUSH a job to a queue. Consumers FETCH jobs from queues, process them and then either ACK (success) or FAIL the job. Faktory will store and re-enqueue failed jobs over time just as Sidekiq does (these are called "retries"). Networks fail and bugs happen, job retries are critical to a "self-healing" production environment. 
<BR><BR>
Many existing job systems provide no persistence or a simple binlog which can be replayed in case of crash. Faktory goes further and provides the same job persistence, state management and monitoring Web UI that Sidekiq does. It uses Facebook's high-performance RocksDB embedded datastore internally to persist all job data, queues, error state, etc. It exposes a Web UI (which is similar to Sidekiq's), allowing you to see the current state of your queues, jobs and workers.

At a high level, Faktory is a work server. It is the repository for background jobs within your application. Jobs have a type and a set of arguments and are placed into queues for workers to fetch and execute.You can use this server to distribute jobs to one or hundreds of machines. Jobs can be executed with any language by clients using the Faktory API to fetch a job from a queue.

Faktory - "Takin' care of business, workin' overtime"

A simple, fast, robust job/task queue for Node.js, backed by Redis.Bee-Queue is meant to power a distributed worker pool and was built with short, real-time jobs in mind. A web server can enqueue a job, wait for a worker process to complete it, and return its results within an HTTP request. Scaling is as simple as running more workers.

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

pg-boss is a job queue built in Node.js on top of PostgreSQL in order to provide background processing and reliable asynchronous execution to Node.js applications. pg-boss relies on SKIP LOCKED, a feature introduced in PostgreSQL 9.5 written specifically for message queues, in order to resolve record locking challenges inherent with relational databases. This brings the safety of guaranteed atomic commits of a relational database to your asynchronous job processing.

pg-boss - Queueing jobs in Node.js using PostgreSQL like a boss 

Discover open source projects across all platforms

Projects

rq - Simple job queues for Python

Celery - Distributed Task Queue

Bull - Premium package for handling jobs and messages in NodeJS

Machinery - Asynchronous task queue/job queue based on distributed message passing

Faktory - "Takin' care of business, workin' overtime"

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

pg-boss - Queueing jobs in Node.js using PostgreSQL like a boss

TechStack

Tagcloud

License

Suggested keywords:

Projects

rq - Simple job queues for Python

Celery - Distributed Task Queue

Bull - Premium package for handling jobs and messages in NodeJS

Machinery - Asynchronous task queue/job queue based on distributed message passing

Faktory - "Takin' care of business, workin' overtime"

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

pg-boss - Queueing jobs in Node.js using PostgreSQL like a boss

TechStack

Tagcloud

License