Airflow Orchestrator
How to orchestrate pipelines with Airflow
When to use it
You should use the Airflow orchestrator if
you're already using Airflow
We're currently reworking the Airflow orchestrator to make sure it works not only locally but also with Airflow instances deployed on cloud infrastructure.
How to deploy it
The Airflow orchestrator works without any additional infrastructure setup.
How to use it
To use the Airflow orchestrator, we need:
The ZenML
airflow
integration installed. If you haven't done so, run
We can then register the orchestrator and use it in our active stack:
Once the orchestrator is part of the active stack, we can provision all required local resources by running:
You can now run any ZenML pipeline using the Airflow orchestrator:
Last updated