Common operators and tasks for Airflow
airflow-common provides common operators, topology helpers, and library management tasks for Apache Airflow workflows.
Key features:
- Common Operators: Convenience operators like
Skip,Fail, andPassfor workflow control - Topology Helpers: Functions like
all_success_any_failureandif_booted_dofor building complex DAG topologies - Library Management: Pydantic models for
PipLibrary,CondaLibrary, andGitRepowith corresponding operators for package installation - Infrastructure Tasks: Operators for system maintenance like
JournalctlClean
Note
This library is built on airflow-pydantic for Pydantic-based Airflow constructs, and integrates seamlessly with airflow-config for YAML-driven DAG definitions using Hydra.
You can install from pip:
pip install airflow-commonOr via conda:
conda install airflow-common -c conda-forgeThis software is licensed under the Apache 2.0 license. See the LICENSE file for details.
Note
This library was generated using copier from the Base Python Project Template repository.