Merge branch 'main' into fix/demos-in-namespaces-with-labels

Author: xeniape

.github/ISSUE_TEMPLATE/pre-release-from-scratch-testing.md

@@ -51,8 +51,6 @@ GitHub handle next to the demo to indicate a particular demo was picked up for t
     | xargs -I {} echo "- [ ] [{}](https://docs.stackable.tech/home/nightly/demos/{})"
 -->
 
-<!-- TODO (@Techassi): Test stacks which don't have a demo -->
-
 - [ ] [airflow-scheduled-job](https://docs.stackable.tech/home/nightly/demos/airflow-scheduled-job)
 - [ ] [argo-cd-git-ops](https://docs.stackable.tech/home/nightly/demos/argo-cd-git-ops)
 - [ ] [data-lakehouse-iceberg-trino-spark](https://docs.stackable.tech/home/nightly/demos/data-lakehouse-iceberg-trino-spark)
@@ -68,6 +66,30 @@ GitHub handle next to the demo to indicate a particular demo was picked up for t
 - [ ] [trino-iceberg](https://docs.stackable.tech/home/nightly/demos/trino-iceberg)
 - [ ] [trino-taxi-data](https://docs.stackable.tech/home/nightly/demos/trino-taxi-data)
 
+## List of stacks
+
+Similar to the demos above we need to test all stacks that don't have a demo.
+Replace the items in the lists below with the applicable Pull Requests (if any). Also put your
+GitHub handle next to the stack to indicate a particular stack was picked up for testing.
+
+> [!TIP]
+> Some of the stacks have a [tutorial](https://docs.stackable.tech/home/nightly/tutorials/) to follow.
+
+<!--
+    The following list was generated by:
+
+    # go to the demos repository, then run:
+    comm -23 \
+      <(yq '.stacks | keys | .[]' stacks/stacks-v2.yaml | sort) \
+      <(yq '.demos[].stackableStack' demos/demos-v2.yaml | sort -u) \
+    | xargs -I {} echo "- [ ] {}"
+-->
+
+- [ ] monitoring
+- [ ] observability
+- [ ] openldap
+- [ ] tutorial-openldap
+
 ## Nightly from Scratch Testing Instructions
 
 These instructions are for deploying and completing the nightly demo from scratch.
@@ -80,9 +102,12 @@ These instructions are for deploying and completing the nightly demo from scratc
 > Be sure to select the _nightly_ docs version on <https://docs.stackable.tech/home/nightly/demos/>.
 
 ```shell
-# Install demo (stable operators) for the nightly release.
+# For demo testing, install demo (stable operators) for the nightly release.
 stackablectl demo install <DEMO_NAME> --release dev
 
+# For stack testing, install stack via
+stackablectl stack install <STACK_NAME> --release dev
+
 # --- IMPORTANT ---
-# Run through the nightly demo instructions (refer to the list above).
+# Run through the (still) nightly demo/stack instructions (refer to the list above).
 ```

.github/ISSUE_TEMPLATE/pre-release-upgrade-testing.md

@@ -51,8 +51,6 @@ GitHub handle next to the demo to indicate a particular demo was picked up for t
     | xargs -I {} echo "- [ ] [{}](https://docs.stackable.tech/home/stable/demos/{})"
 -->
 
-<!-- TODO (@Techassi): Test stacks which don't have a demo -->
-
 - [ ] [airflow-scheduled-job](https://docs.stackable.tech/home/stable/demos/airflow-scheduled-job)
 - [ ] [argo-cd-git-ops](https://docs.stackable.tech/home/stable/demos/argo-cd-git-ops)
 - [ ] [data-lakehouse-iceberg-trino-spark](https://docs.stackable.tech/home/stable/demos/data-lakehouse-iceberg-trino-spark)
@@ -68,6 +66,30 @@ GitHub handle next to the demo to indicate a particular demo was picked up for t
 - [ ] [trino-iceberg](https://docs.stackable.tech/home/stable/demos/trino-iceberg)
 - [ ] [trino-taxi-data](https://docs.stackable.tech/home/stable/demos/trino-taxi-data)
 
+## List of stacks
+
+Similar to the demos above we need to test all stacks that don't have a demo.
+Replace the items in the lists below with the applicable Pull Requests (if any). Also put your
+GitHub handle next to the stack to indicate a particular stack was picked up for testing.
+
+> [!TIP]
+> Some of the stacks have a [tutorial](https://docs.stackable.tech/home/nightly/tutorials/) to follow.
+
+<!--
+    The following list was generated by:
+
+    # go to the demos repository, then run:
+    comm -23 \
+      <(yq '.stacks | keys | .[]' stacks/stacks-v2.yaml | sort) \
+      <(yq '.demos[].stackableStack' demos/demos-v2.yaml | sort -u) \
+    | xargs -I {} echo "- [ ] {}"
+-->
+
+- [ ] monitoring
+- [ ] observability
+- [ ] openldap
+- [ ] tutorial-openldap
+
 ## Stable to Nightly Upgrade Testing Instructions
 
 These instructions are for deploying and completing the stable demo, and then
@@ -82,11 +104,14 @@ the operators and CRDS.
 > Be sure to select the _stable_ docs version on <https://docs.stackable.tech/home/stable/demos/>.
 
 ```shell
-# Install demo (stable operators) for the stable release (OO.M).
+# For demo testing, , install demo (stable operators) for the stable release (OO.M).
 stackablectl demo install <DEMO_NAME>
 
+# For stack testing, install stack via
+stackablectl stack install <STACK_NAME>
+
 # --- IMPORTANT ---
-# Run through the stable demo instructions (refer to the list above).
+# Run through the (still) nightly demo/stack instructions (refer to the list above).
 
 # Get a list of installed operators
 stackablectl operator installed --output=plain

.github/ISSUE_TEMPLATE/release-from-scratch-testing.md

@@ -68,50 +68,48 @@ GitHub handle next to the demo to indicate a particular demo was picked up for t
 - [ ] [trino-iceberg](https://docs.stackable.tech/home/nightly/demos/trino-iceberg)
 - [ ] [trino-taxi-data](https://docs.stackable.tech/home/nightly/demos/trino-taxi-data)
 
-### YY.M.X from Scratch Testing Instructions
-
-These instructions are for deploying and completing the YY.M.X demo from scratch.
-
-<!--
-    Make sure to update the version mentioned below when creating the issue.
--->
-
-> [!TIP]
-> Be sure to select the _nightly_ docs version on <https://docs.stackable.tech/home/nightly/demos/>.
-
-```shell
-# Install demo (stable operators) for the nightly release.
-stackablectl demo install <DEMO_NAME>
-
-# --- IMPORTANT ---
-# Run through the nightly demo instructions (refer to the list above).
-```
-
-## List of Stacks
+## List of stacks
 
-Some stacks are not used by demos, but still need testing in some way.
+Similar to the demos above we need to test all stacks that don't have a demo.
+Replace the items in the lists below with the applicable Pull Requests (if any). Also put your
+GitHub handle next to the stack to indicate a particular stack was picked up for testing.
 
 > [!TIP]
 > Some of the stacks have a [tutorial](https://docs.stackable.tech/home/nightly/tutorials/) to follow.
 
 <!--
     The following list was generated by:
 
-    # Using the real `yq` that follows the same interface as `jq`
-    yq -y --slurp '.[0] * .[1] | .allStacks - .usedStacks' \
-        <(cat demos/demos-v2.yaml| yq '{usedStacks: [.demos[] | .stackableStack]}') \
-        <(cat stacks/stacks-v2.yaml | yq '{allStacks: [.stacks | keys] | flatten}') \
-    | sed -e 's/^- /- [ ] /g' \
-    | sort
+    # go to the demos repository, then run:
+    comm -23 \
+      <(yq '.stacks | keys | .[]' stacks/stacks-v2.yaml | sort) \
+      <(yq '.demos[].stackableStack' demos/demos-v2.yaml | sort -u) \
+    | xargs -I {} echo "- [ ] {}"
 -->
 
 - [ ] monitoring
 - [ ] observability
 - [ ] openldap
 - [ ] tutorial-openldap
 
-You can install the stack via:
+### YY.M.X from Scratch Testing Instructions
+
+These instructions are for deploying and completing the YY.M.X demo from scratch.
+
+<!--
+    Make sure to update the version mentioned below when creating the issue.
+-->
+
+> [!TIP]
+> Be sure to select the _nightly_ docs version on <https://docs.stackable.tech/home/nightly/demos/>.
 
 ```shell
-stackablectl stack install <STACK_NAME> --release dev
+# For demo testing, install demo (stable operators) for the YY.M.X release.
+stackablectl demo install <DEMO_NAME>
+
+# For stack testing, install stack via
+stackablectl stack install <STACK_NAME>
+
+# --- IMPORTANT ---
+# Run through the (still) nightly demo/stack instructions (refer to the list above).
 ```

stacks/stacks-v2.yaml

@@ -457,48 +457,6 @@ stacks:
       - name: minioAdminPassword
         description: Password of the MinIO admin user
         default: adminadmin
-  airflow-trino-dbt:
-    description: Stack containing Airflow and Trino using Apache Iceberg as a S3 backend for dbt jobs
-    stackableRelease: dev
-    stackableOperators:
-      - commons
-      - listener
-      - secret
-      - hive
-      - trino
-      - opa
-      - airflow
-    labels:
-      - trino
-      - opa
-      - iceberg
-      - minio
-      - s3
-    manifests:
-      - helmChart: https://raw.githubusercontent.com/stackabletech/demos/main/stacks/_templates/postgresql-hive-iceberg.yaml
-      - helmChart: https://raw.githubusercontent.com/stackabletech/demos/main/stacks/_templates/postgresql-airflow.yaml
-      - plainYaml: https://raw.githubusercontent.com/stackabletech/demos/main/stacks/trino-iceberg/s3-connection.yaml
-      - plainYaml: stacks/airflow-trino-dbt/hive-metastores.yaml
-      - plainYaml: stacks/airflow-trino-dbt/trino.yaml
-      - plainYaml: stacks/airflow-trino-dbt/airflow.yaml
-      - plainYaml: stacks/airflow-trino-dbt/rbac.yaml
-      - plainYaml: stacks/airflow-trino-dbt/opa-rules.yaml
-      - plainYaml: stacks/airflow-trino-dbt/opa.yaml
-      - plainYaml: stacks/airflow-trino-dbt/minio.yaml
-    supportedNamespaces: ["default"]
-    parameters:
-      - name: trinoAdminPassword
-        description: Password of the Trino admin user
-        default: adminadmin
-      - name: minioAdminPassword
-        description: Password of the MinIO admin user
-        default: adminadmin
-      - name: airflowAdminPassword
-        description: Password of the MinIO admin user
-        default: adminadmin
-      - name: airflowSecretKey
-        description: Airflow's secret key used to generate e.g. user session tokens
-        default: airflowSecretKey
   jupyterhub-pyspark-hdfs:
     description: Jupyterhub with PySpark and HDFS integration
     stackableRelease: dev