Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

Celery - Distributed Task Queue

Apache RocketMQ is a distributed messaging and streaming platform with low latency, high performance and reliability, trillion-level capacity and flexible scalability.
 
Its features include: 
<ul>
<li>Pub/Sub messaging model</li>
<li>Scheduled message delivery</li>
<li>Message retroactivity by time or offset</li>
<li>Log hub for streaming</li>
<li>Big data integration</li>
<li>Reliable FIFO and strict ordered messaging in the same queue</li>
<li>Efficient pull&amp;push consumption model</li>
<li>Million-level message accumulation capacity in a single queue</li>
<li>Multiple messaging protocols like JMS and OpenMessaging</li>
<li>Flexible distributed scale-out deployment architecture</li>
<li>Lightning-fast batch message exchange system</li>
<li>Various message filter mechanics such as SQL and Tag</li>
<li>Docker images for isolated testing and cloud isolated clusters</li>
<li>Feature-rich administrative dashboard for configuration, metrics and monitoring</li>
</ul>

Apache RocketMQ is a distributed messaging and streaming platform with low latency, high performance and reliability, trillion-level capacity and flexible scalability.

RocketMQ - Distributed messaging and streaming data platform

NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee. It scales horizontally, without any centralized brokers. Built-in discovery simplifies the addition of nodes to the cluster.
 
<ul>
 <li>support distributed topologies with no SPOF</li>
 <li>horizontally scalable (no brokers, seamlessly add more nodes to the cluster)</li>
 <li>low-latency push based message delivery </li>
 <li>combination load-balanced and multicast style message routing</li>
 <li>excel at both streaming (high-throughput) and job oriented (low-throughput) workloads</li>
 <li>primarily in-memory (beyond a high-water mark messages are transparently kept on disk)</li>
 <li>runtime discovery service for consumers to find producers</li>
 <li>transport layer security (TLS)</li>
 <li>data format agnostic</li>
 <li>few dependencies (easy to deploy) and a sane, bounded, default configuration</li>
 <li>simple TCP protocol supporting client libraries in any language</li>
 <li>HTTP interface for stats, admin actions, and producers (no client library needed to publish)</li>
 <li>integrates with statsd for realtime instrumentation</li>
 <li>robust cluster administration interface</li>
</ul>

NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee. It scales horizontally, without any centralized brokers. Built-in discovery simplifies the addition of nodes to the cluster.

NSQ - A realtime distributed messaging platform in Go

Gearman provides a generic application framework to farm out work to other machines or processes that are better suited to do the work. It allows you to do work in parallel by doing load balancing. It also supports to call functions between languages. It is the nervous system for how distributed processing communicates. It is fault tolerant. A Gearman powered application consists of three parts: a client, a worker, and a job server. The client is responsible for creating a job to be run and sending it to a job server. The job server will find a suitable worker that can run the job and forwards the job on. The worker performs the work requested by the client and sends a response to the client through the job server.

Gearman provides a generic application framework to farm out work to other machines or processes that are better suited to do the work. It allows you to do work in parallel by doing load balancing. It also supports to call functions between languages. It is the nervous system for how distributed processing communicates. It is fault tolerant.

Gearman - Application Framework to farm out work to other Machines

Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API. It is horizontally scalable (Millions of independent topics and millions of messages published per second), Strong ordering and consistency guarantees, Low latency , REST API, Geo Replication and lot more.

Pulsar - Distributed pub-sub Messaging System from Yahoo

A simple, fast, robust job/task queue for Node.js, backed by Redis.Bee-Queue is meant to power a distributed worker pool and was built with short, real-time jobs in mind. A web server can enqueue a job, wait for a worker process to complete it, and return its results within an HTTP request. Scaling is as simple as running more workers.

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

CassieQ is a distributed queue built on cassandra. CassieQ leverages bucketing of messages to avoid queues modeled off deletes.

cassieq - A distributed queue built off cassandra

Discover open source projects across all platforms

Projects

Celery - Distributed Task Queue

RocketMQ - Distributed messaging and streaming data platform

NSQ - A realtime distributed messaging platform in Go

Gearman - Application Framework to farm out work to other Machines

Pulsar - Distributed pub-sub Messaging System from Yahoo

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

cassieq - A distributed queue built off cassandra

TechStack

Tagcloud

License

Suggested keywords:

Projects

Celery - Distributed Task Queue

RocketMQ - Distributed messaging and streaming data platform

NSQ - A realtime distributed messaging platform in Go

Gearman - Application Framework to farm out work to other Machines

Pulsar - Distributed pub-sub Messaging System from Yahoo

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

cassieq - A distributed queue built off cassandra

TechStack

Tagcloud

License