Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows. Azkaban was designed primarily with usability in mind. It has been running at LinkedIn for several years, and drives many of their Hadoop and data warehouse processes.
<BR><BR>
Its features include: <BR>
<ul><li><li>Compatible with any version of Hadoop</li><li>Easy to use web UI</li><li>Simple web and http workflow uploads</li><li>Project workspaces</li><li>Scheduling of workflows</li><li>Modular and pluginable</li><li>Authentication and Authorization</li><li>Tracking of user actions</li><li>Email alerts on failure and successes</li><li>SLA alerting and auto killing</li><li>Retrying of failed jobs</li></li></ul>

Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows. Azkaban was designed primarily with usability in mind. It has been running at LinkedIn for several years, and drives many of their Hadoop and data warehouse processes.

Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs

Oozie is a workflow scheduler system to manage Apache Hadoop jobs. Its jobs are Directed Acyclical Graphs (DAGs) of actions and triggered by time (frequency) and data availability. Oozie is integrated with the rest of the Hadoop stack supporting several types of Hadoop jobs out of the box (such as Java map-reduce, Streaming map-reduce, Pig, Hive, Sqoop and Distcp) as well as system specific jobs (such as Java programs and shell scripts).

Apache Oozie - Workflow Scheduler for Hadoop

Discover open source projects across all platforms

Projects

Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs

Apache Oozie - Workflow Scheduler for Hadoop

TechStack

Tagcloud

Suggested keywords:

Projects

Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs

Apache Oozie - Workflow Scheduler for Hadoop

TechStack

Tagcloud