Gaffer is a graph database framework. It allows the storage of very large graphs containing rich properties on the nodes and edges. Several storage options are available, including Accumulo, Hbase and Parquet. It is designed to be as flexible, scalable and extensible as possible, allowing for rapid prototyping and transition to production systems.

Gaffer - A large-scale entity and relation database supporting aggregation of properties

Alluxio (formerly known as Tachyon) is a virtual distributed storage system. It bridges the gap between computation frameworks and storage systems, enabling computation applications to connect to numerous storage systems through a common interface.
 
Alluxio enables data orchestration for compute in any cloud. It unifies data silos on-premise and across any cloud to give you the data locality, accessibility, and elasticity needed to reduce the complexities associated with orchestrating data for today’s big data and AI/ML workloads.

Alluxio (formerly known as Tachyon) is a virtual distributed storage system. It bridges the gap between computation frameworks and storage systems, enabling computation applications to connect to numerous storage systems through a common interface.

Alluxio - Data orchestration for analytics and machine learning in the cloud

Cube.js is an open-source analytical API platform. It is primarily used to build internal business intelligence tools or add customer-facing analytics to existing applications. Cube.js was designed to work with serverless data warehouses and query engines like Google BigQuery and AWS Athena. A multi-stage querying approach makes it suitable for handling trillions of data points. Most modern RDBMS work with Cube.js as well and can be further tuned for performance.

Cube.js — Open-Source Analytical API Platform

Gimel provides unified Data API to access data from any storage like HDFS, GS, Alluxio, Hbase, Aerospike, BigQuery, Druid, Elastic, Teradata, Oracle, MySQL, etc.

Gimel - PayPal's Big Data Processing Framework

Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage). As an organization, Hudi can help you build an efficient data lake, solving some of the most complex, low-level storage management problems, while putting data into hands of your data analysts, engineers and scientists much quicker.
 
Features: 
<ul>
<li>Upsert support with fast, pluggable indexing</li>
<li>Atomically publish data with rollback support</li>
<li>Snapshot isolation between writer &amp; queries</li>
<li>Savepoints for data recovery</li>
<li>Manages file sizes, layout using statistics</li>
<li>Async compaction of row &amp; columnar data</li>
<li>Timeline metadata to track lineage</li>
<li>Optimize data lake layout with clustering</li>
</ul>

Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage). As an organization, Hudi can help you build an efficient data lake, solving some of the most complex, low-level storage management problems, while putting data into hands of your data analysts, engineers and scientists much quicker.

Apache Hudi - Streaming Data Lake Platform

Discover open source projects across all platforms

Projects

Gaffer - A large-scale entity and relation database supporting aggregation of properties

Alluxio - Data orchestration for analytics and machine learning in the cloud

Cube.js — Open-Source Analytical API Platform

Gimel - PayPal's Big Data Processing Framework

Apache Hudi - Streaming Data Lake Platform

TechStack

Tagcloud

License

Suggested keywords:

Projects

Gaffer - A large-scale entity and relation database supporting aggregation of properties

Alluxio - Data orchestration for analytics and machine learning in the cloud

Cube.js — Open-Source Analytical API Platform

Gimel - PayPal's Big Data Processing Framework

Apache Hudi - Streaming Data Lake Platform

TechStack

Tagcloud

License