Azkaban Roadmap

Jump to bottom Edit New page

David Z. Chen edited this page Jun 17, 2014 · 3 revisions

Near-term

2.6

Azkaban DSL and Gradle Plugin
Clean up and improve existing tests
Gradle-ize azkaban-plugins

2.7

Operationalization tooling and improved monitoring
Improve scalability with multiple executors

Mid-term

New visualizers (Hive, Tez)
Open up DSL to other tools
Improve plugin interfaces
Executor high-availability
Make AJAX endpoints (i.e. for running and getting information on flows) RESTful

Future ideas

Conditional branching
Data availability triggers
Hive Metastore browser
Pluggable executors (e.g. launching YARN containers)
Persistance storage server
Launching and monitoring long-living jobs (i.e. Samza, Storm, etc)