Install the Stackable Airflow operator, the software that Airflow depends on — PostgreSQL and Redis — as well as the commons, secret and listener operator which are required by all Stackable operators.
PostgreSQL is required by Airflow to store metadata about DAG runs, and Redis is required by the Celery executor to schedule and/or queue DAG jobs. They are components that may well already be available for customers, in which case they are treated as prerequisites for an Airflow cluster and hence as part of the installation process. Install these components using Helm. Note that specific versions are declared:
link:example$getting_started/code/getting_started.sh[role=include]link:example$getting_started/code/getting_started.sh[role=include]|
Warning
|
Do not use this setup in production! Supported databases and versions are listed on the required external components page for this operator. Follow the instructions of those components for a production setup. |
There are multiple ways to install the Stackable operator for Apache Airflow. management:stackablectl:index.adoc is the preferred way, but Helm is also supported. OpenShift users may prefer installing the operator from the RedHat Certified Operator catalog using the OpenShift web console.
- stackablectl
-
stackablectl is the command line tool to interact with Stackable operators and our recommended way to install operators. Follow the installation steps for your platform.
After you have installed stackablectl run the following command to install all operators necessary for Airflow:
link:example$getting_started/code/getting_started.sh[role=include]
The tool shows
link:example$getting_started/code/install_output.txt[role=include]TipConsult the management:stackablectl:quickstart.adoc to learn more about how to use stackablectl. For example, you can use the --cluster kindflag to create a Kubernetes cluster with kind. - Helm
-
You can also use Helm to install the operators.
Notehelm reposubcommands are not supported for OCI registries. The operators are installed directly, without adding the Helm Chart repository first.Install the Stackable operators:
link:example$getting_started/code/getting_started.sh[role=include]
Helm deploys the operators in a Kubernetes Deployment. Each operator installs and maintains its own CRDs at startup (see concepts:maintenance/crds.adoc).
Set up an Airflow cluster and its dependencies and verify that it works by inspecting and running an example DAG.