Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows. Azkaban consists of 3 key components:
- Relational Database (MySQL)
- AzkabanWebServer
- AzkabanExecutorServer
This repository contains Dockerfiles of Azkaban for Docker.
Dockerfiles is base on : puckel docker-azkaban.
- Official alpine
-
Install Docker.
-
Install Docker-compose.
-
Download automated builds
- azkaban-webserver from public Docker Hub Registry:
docker pull lipengyu/azkaban-webserver
- azkaban-executor from public Docker Hub Registry:
docker pull lipengyu/azkaban-executor
- Alternatively, you can build an image from Dockerfile.
docker-compose up -d
docker-compose ps
The repository contains a shell script to test the azkaban stack: testing/test_api.sh (require jq).