Apache Doris is a modern MPP analytical database product. It can provide sub-second queries and efficient real-time data analysis. With it's distributed architecture, up to 10PB level datasets will be well supported and easy to operate. Doris provides batch data loading and real-time mini-batch data loading. It provides high availability, reliability, fault tolerance, and scalability. Its original name was Palo, developed in Baidu. 
 
<ul><li>Uses MySQL protocol to communicate. Users can connect to Doris cluster through MySQL client or MySQL JDBC</li><li>Support standard SQL language, compatible with MySQL protocol</li><li>Vectorized SQL executor</li><li>Getting result of a query within one second</li><li>Rollup, novel pre-computation mechanism
</li><li>Effective data model for aggregation</li><li>High performance, high availability, high reliability</li><li>Easy for operation, Elastic data warehouse for big data</li></ul>

Apache Doris is a modern MPP analytical database product. It can provide sub-second queries and efficient real-time data analysis. With it's distributed architecture, up to 10PB level datasets will be well supported and easy to operate. Doris provides batch data loading and real-time mini-batch data loading. It provides high availability, reliability, fault tolerance, and scalability. Its original name was Palo, developed in Baidu. 

Apache Doris -  A fast MPP database for all modern analytics on big data

Apache Mnemonic is a non-volatile hybrid memory storage oriented library, it proposed a non-volatile/durable Java object model and durable computing service that bring several advantages to significantly improve the performance of massive real-time data processing/analytics. developers are able to use this library to design their cache-less and SerDe-less high performance applications.
<ul>
<li>In-place data storage on local non-volatile memory</li>
<li>Durable Object Model (DOM)</li>
<li>Durable Native Computing Model (DNCM)</li>
<li>Object graphs lazy loading &amp; sharing</li>
<li>Auto-reclaim memory resources and Mnemonic objects</li>
<li>Hierarchical cache pool for massive data caching</li>
<li>Extensible memory services for new device adoption and allocation optimization</li>
<li>Durable data structure collection(WIP)</li>
<li>Durable computing service</li>
<li>Minimize memory footprint of on-heap</li>
<li>Reduce GC Overheads as the following chart shown (collected from Apache Spark experiments)</li>
<li>Drop-in Hadoop MapReduce support</li>
<li>Drop-in Hadoop Spark support</li>
</ul>

Apache Mnemonic is a non-volatile hybrid memory storage oriented library, it proposed a non-volatile/durable Java object model and durable computing service that bring several advantages to significantly improve the performance of massive real-time data processing/analytics. developers are able to use this library to design their cache-less and SerDe-less high performance applications.

Apache Mnemonic -  Non-volatile hybrid memory storage oriented library

Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage). As an organization, Hudi can help you build an efficient data lake, solving some of the most complex, low-level storage management problems, while putting data into hands of your data analysts, engineers and scientists much quicker.
 
Features: 
<ul>
<li>Upsert support with fast, pluggable indexing</li>
<li>Atomically publish data with rollback support</li>
<li>Snapshot isolation between writer &amp; queries</li>
<li>Savepoints for data recovery</li>
<li>Manages file sizes, layout using statistics</li>
<li>Async compaction of row &amp; columnar data</li>
<li>Timeline metadata to track lineage</li>
<li>Optimize data lake layout with clustering</li>
</ul>

Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage). As an organization, Hudi can help you build an efficient data lake, solving some of the most complex, low-level storage management problems, while putting data into hands of your data analysts, engineers and scientists much quicker.

Apache Hudi - Streaming Data Lake Platform

Discover open source projects across all platforms

Projects

Apache Doris - A fast MPP database for all modern analytics on big data

Apache Mnemonic - Non-volatile hybrid memory storage oriented library

Apache Hudi - Streaming Data Lake Platform

TechStack

Tagcloud

Suggested keywords:

Projects

Apache Doris - A fast MPP database for all modern analytics on big data

Apache Mnemonic - Non-volatile hybrid memory storage oriented library

Apache Hudi - Streaming Data Lake Platform

TechStack

Tagcloud