Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets, original contributed from eBay Inc. It is designed to reduce query latency on Hadoop for 10+ billions of rows of data. It offers ANSI SQL on Hadoop and supports most ANSI SQL query functions. 
 
Its fundamental framework of Kylin OLAP Engine comprises of Metadata Engine, Query Engine, Job Engine and Storage Engine to run the entire stack. It also includes a REST Server to service client requests.

Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets, original contributed from eBay Inc. It is designed to reduce query latency on Hadoop for 10+ billions of rows of data. It offers ANSI SQL on Hadoop and supports most ANSI SQL query functions. 

Kylin - Extreme OLAP Engine for Big Data

Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. It can ingest data from offline data sources (such as Hadoop and flat files) as well as online sources (such as Kafka). Pinot is designed to scale horizontally, so that it can scale to larger data sets and higher query rates as needed.
 
Its features include: 
<ul>
<li>A column-oriented database with various compression schemes such as Run Length, Fixed Bit Length</li>
<li>Pluggable indexing technologies - Sorted Index, Bitmap Index, Inverted Index</li>
<li>Ability to optimize query/execution plan based on query and segment metadata .</li>
<li>Near real time ingestion from Kafka and batch ingestion from Hadoop</li>
<li>SQL like language that supports selection, aggregation, filtering, group by, order by, distinct queries on fact data.</li>
<li>Support for multivalued fields</li>
<li>Horizontally scalable and fault tolerant</li>
</ul>

Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. It can ingest data from offline data sources (such as Hadoop and flat files) as well as online sources (such as Kafka). Pinot is designed to scale horizontally, so that it can scale to larger data sets and higher query rates as needed.

Pinot - A realtime distributed OLAP datastore

Lens provides an Unified Analytics interface. Lens aims to cut the Data Analytics silos by providing a single view of data across multiple tiered data stores and optimal execution environment for the analytical query. It provides a simple metadata layer which provides an abstract view over tiered data stores.

Lens - Unified Analytics interface

Discover open source projects across all platforms

Projects

Kylin - Extreme OLAP Engine for Big Data

Pinot - A realtime distributed OLAP datastore

Lens - Unified Analytics interface

Tagcloud

Suggested keywords:

Projects

Kylin - Extreme OLAP Engine for Big Data

Pinot - A realtime distributed OLAP datastore

Lens - Unified Analytics interface

Tagcloud