Apache Flink is an open source platform for scalable batch and stream data processing. Flink’s core is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.


Apache Flink - Platform for Scalable Batch and Stream Data Processing

Kapacitor is a open source framework for processing, monitoring, and alerting on time series data. Kapacitor imports (stream or batch) time series data, and then transform, analyze, and act on the data. It uses Telegraf to collect system metrics on your local machine and store them in InfluxDB.
<BR><BR>
Kapacitor’s alerting system follows a publish-subscribe design pattern. Alerts are published to topics and handlers subscribe to a topic. This pub/sub model and the ability for these to call User Defined Functions make Kapacitor very flexible to act as the control plane in your environment, performing tasks like auto-scaling, stock reordering, and IoT device control.

Kapacitor is a open source framework for processing, monitoring, and alerting on time series data. Kapacitor imports (stream or batch) time series data, and then transform, analyze, and act on the data. It uses Telegraf to collect system metrics on your local machine and store them in InfluxDB.

Kapacitor - Open source framework for processing, monitoring, and alerting on time series data

Hazelcast Jet is a distributed computing platform built for high-performance stream processing and fast batch processing. It embeds Hazelcast In Memory Data Grid (IMDG) to provide a lightweight package of a processor and a scalable in-memory storage. It supports distributed java.util.stream API support for Hazelcast data structures such as IMap and IList, Distributed implementations of java.util.{Queue, Set, List, Map} data structures highly optimized to be used for the processing

Hazelcast Jet - Distributed data processing engine, built on top of Hazelcast

Apache Beam is an open source, unified model for defining both batch and streaming data-parallel processing pipelines. Using one of the open source Beam SDKs, you build a program that defines the pipeline. The pipeline is then executed by one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow.
<BR><BR>
Beam is particularly useful for Embarrassingly Parallel data processing tasks, in which the problem can be decomposed into many smaller bundles of data that can be processed independently and in parallel. You can also use Beam for Extract, Transform, and Load (ETL) tasks and pure data integration. These tasks are useful for moving data between different storage media and data sources, transforming data into a more desirable format, or loading data onto a new system.

Apache Beam is an open source, unified model for defining both batch and streaming data-parallel processing pipelines. Using one of the open source Beam SDKs, you build a program that defines the pipeline. The pipeline is then executed by one of Beam’s supported distributed processing back-ends, which include Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow.

Apache Beam - Unified model for defining both batch and streaming data-parallel processing pipelines

Discover open source projects across all platforms

Projects

Apache Flink - Platform for Scalable Batch and Stream Data Processing

Kapacitor - Open source framework for processing, monitoring, and alerting on time series data

Hazelcast Jet - Distributed data processing engine, built on top of Hazelcast

Apache Beam - Unified model for defining both batch and streaming data-parallel processing pipelines

TechStack

Tagcloud

License

Suggested keywords:

Projects

Apache Flink - Platform for Scalable Batch and Stream Data Processing

Kapacitor - Open source framework for processing, monitoring, and alerting on time series data

Hazelcast Jet - Distributed data processing engine, built on top of Hazelcast

Apache Beam - Unified model for defining both batch and streaming data-parallel processing pipelines

TechStack

Tagcloud

License