AzkabanCLI wrapper for easier workflow definition.
pip install git+https://[email protected]/vanaoff/workflow.git@master
Workflow definition example could be found in ./example.
Workflow could be built and uploaded by executing
python -m workflow --definition project.yml --extra-properties extra.yml --files-to-upload files-i-need --azkaban-url https://user:[email protected]:443or equivalently
python -m workflow -d project.yml -e extra.yml -f files-i-need -u https://user:[email protected]:443It's convenient to create ~/.azkabanrc file in your home directory with following structure:
[alias.one]
url = https://user:[email protected]:443
[alias.two]
url = https://different-user:[email protected]:443Once it's available, it's possible to reference azkaban connection url with --alias, resp. -a, argument, so
previous example will become
python -m workflow -d project.yml -e extra.yml -f files-i-need -a one For local build use --local/-l switch.
All options could be printed with python -m workflow -h.