Merge branch 'main' into feat/hadoop-rework

# Conflicts:
#	hadoop/Dockerfile

Author: lfrancke

.gitattributes

@@ -0,0 +1 @@
+nix/** linguist-generated

.github/ISSUE_TEMPLATE/add-product.md

@@ -0,0 +1,30 @@
+---
+name: Add new Product
+about: >-
+  This template contains instructions specific to adding a new product.
+title: >-
+  tracking: Add new product <PRODUCT>
+labels: []
+# Currently, projects cannot be assigned via front-matter.
+projects: ['stackabletech/10']
+assignees: ''
+---
+
+```[tasklist]
+### Tasks
+- [ ] Create a new top-level folder for the product. The name of the folder must
+      use the lowercase product name.
+- [ ] Create a README.md file outlining special considerations required to
+      update or run the product. See existing README files as a guide of
+      reference.
+- [ ] Add a `versions.py` file to the folder. Add all required key-value pairs.
+- [ ] Add a new "Update Product" issue template in `.github/ISSUE_TEMPLATE/`
+      folder. See existing ones as a guide of reference.
+- [ ] Add a new `dev_<PRODUCT>.yml` GitHub Action workflow in the
+      `.github/workflows` folder. Use existing local action whenever possible
+      or consider creating a new one when there is no fitting action available.
+- [ ] Run `.scripts/update_readme_badges.sh` to generate the new status badge.
+```
+
+_Please consider updating this template if these instructions are wrong, or
+could be made clearer._

.github/ISSUE_TEMPLATE/early-pre-release.md

@@ -0,0 +1,62 @@
+---
+name: Early Pre-Release Container Image Updates
+about: This template can be used to track the container image updates leading up to the next Stackable release
+title: "chore: Update Container Images for Stackable Release XX.(X)X"
+labels: ['epic']
+assignees: ''
+---
+
+<!--
+    DO NOT REMOVE THIS COMMENT. It is intended for people who might copy/paste from the previous release issue.
+    This was created by an issue template: https://github.com/stackabletech/docker-images/issues/new/choose.
+-->
+
+<!-- Update this with the parent tracking issue for the release -->
+Part of stackabletech/issues#xxx.
+
+## Container Image Updates for Stackable Release XX.(X)X
+
+> [!NOTE]
+> Update the product versions based on what has been decided upon in the _Product Spreadsheet[^1]_.
+
+[^1]: Currently this is a private spreadsheet
+
+Replace the items in the task lists below with the subsequent tracking issue.
+
+<!--
+    Find templates for bases/products:
+
+    find .github/ISSUE_TEMPLATE/update-*.md -printf "%f\n" \
+    | sort \
+    | xargs -I {} echo "- [ ] https://github.com/stackabletech/docker-images/issues/new?template={}"
+-->
+
+<!-- todo: consider removing the ubi*-rust-builder from the release process. -->
+```[tasklist]
+### Product Container Images
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-base-java.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-base-stackable.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-base-ubi-rust-builders.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-base-vector.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-airflow.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-druid.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-hbase-phoenix-omid.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-hdfs.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-hive.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-kafka.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-nifi.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-opa.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-spark.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-superset.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-trino.md
+- [ ] https://github.com/stackabletech/docker-images/issues/new?template=update-product-zookeeper.md
+```
+
+```[tasklist]
+### Additional items which don't have a tracking issue
+- [ ] hello-world
+- [ ] krb5
+- [ ] tools
+- [ ] testing-tools
+- [ ] statsd_exporter
+```

.github/ISSUE_TEMPLATE/pre-release.md

@@ -0,0 +1,84 @@
+---
+name: Update Java Bases
+about: >-
+  This template contains instructions specific to updating this product and/or
+  container image(s).
+title: >-
+  chore(java-bases): Update container images ahead of Stackable Release XX.(X)X
+labels: []
+# Currently, projects cannot be assigned via front-matter.
+projects: ['stackabletech/10']
+assignees: ''
+---
+
+Part of #xxx.
+
+<!--
+This gives hints to the person doing the work.
+Add/Change/Remove anything that isn't applicable anymore
+-->
+- Add: `x.x.x`
+- Remove: `y.y.y`
+
+> [!TIP]
+> Please add the `scheduled-for/20XX-XX` label, and add to the [Stackable Engineering][1] project.
+>
+> [1]: https://github.com/orgs/stackabletech/projects/10
+
+<!-- markdownlint-disable-next-line MD028 -->
+> [!IMPORTANT]
+>
+> - `java-base` uses [vector](https://github.com/stackabletech/docker-images/blob/main/vector/Dockerfile) and is used as a base for java products.
+> - `java-devel` uses [stackable-base](https://github.com/stackabletech/docker-images/blob/main/stackable-base/Dockerfile) and is used to build java products.
+
+Typically product updates will determine which version of Java is required, but
+we should also make new versions of Java available for use.
+
+> [!TIP]
+> You can search for available java versions at [rpmfind.net], and search the
+> term `openjdk-headless`.
+> _It isn't perfect, as it will depend on what is available via microdnf._
+
+```[tasklist]
+### Update tasks
+- [ ] Add any new versions of java to both `java-base/versions.py` and `java-devel/versions.py`
+- [ ] Remove versions when there are no long any references (eg: `grep java- **/versions.py | grep "1.8.0"`)
+```
+
+```[tasklist]
+### Related Pull Requests
+- [ ] _Link to the docker-images PR (product update)_
+```
+
+This list should be completed by the assignee(s), once respective PRs have been merged. Once all items have been checked, the issue can be moved into _Development: Done_.
+
+```[tasklist]
+### Acceptance
+- [ ] Can build a product image that uses the new version(s)
+- [ ] Both `java-base` and `java-devel` have the same Java versions in `versions.py`
+- [ ] Kuttl smoke test passes locally for a product using the new Java version
+```
+
+<details>
+<summary>Testing instructions</summary>
+
+```shell
+# See the latest version at https://pypi.org/project/image-tools-stackabletech/
+pip install image-tools-stackabletech==0.0.13
+
+# Test a product image can build, eg: ZooKeeper
+bake --product zookeeper=x.y.z # where x.y.z is a valid product version using the newly added Java version
+
+kind load docker-image docker.stackable.tech/stackable/zookeeper:x.y.z-stackable0.0.0-dev
+
+# Change directory into one of the operator repositories (eg: zookeeper-operator) and update the
+# product version in tests/test-definition.yaml
+./scripts/run-tests --test-suite smoke-latest # or similar
+```
+
+</details>
+
+_Please consider updating this template if these instructions are wrong, or
+could be made clearer._
+
+[rpmfind.net]: https://rpmfind.net/linux/RPM/Development_Java.html

.github/ISSUE_TEMPLATE/update-base-java.md

@@ -0,0 +1,64 @@
+---
+name: Update Stackable Base
+about: >-
+  This template contains instructions specific to updating this product and/or
+  container image(s).
+title: >-
+  chore(stackable-base): Update container images ahead of Stackable Release XX.(X)X
+labels: []
+# Currently, projects cannot be assigned via front-matter.
+projects: ['stackabletech/10']
+assignees: ''
+---
+
+Part of #xxx.
+
+<!--
+This gives hints to the person doing the work.
+Add/Change/Remove anything that isn't applicable anymore
+-->
+- Add: `x.x.x`
+- Remove: `y.y.y`
+
+> [!TIP]
+> Please add the `scheduled-for/20XX-XX` label, and add to the [Stackable Engineering][1] project.
+>
+> [1]: https://github.com/orgs/stackabletech/projects/10
+
+```[tasklist]
+### Update tasks
+- [ ] Update UBI version hash in the Dockerfile (`FROM`)
+- [ ] Update `RUST_DEFAULT_TOOLCHAIN_VERSION`
+- [ ] Update `CARGO_CYCLONEDX_CRATE_VERSION`
+- [ ] Update `CARGO_AUDITABLE_CRATE_VERSION`
+- [ ] Update `PROTOC_VERSION`
+- [ ] Update `CONFIG_UTILS_VERSION`
+```
+
+```[tasklist]
+### Related Pull Requests
+- [ ] _Link to the docker-images PR (product update)_
+```
+
+This list should be completed by the assignee(s), once respective PRs have been merged. Once all items have been checked, the issue can be moved into _Development: Done_.
+
+```[tasklist]
+### Acceptance
+- [ ] Can build the image locally
+- [ ] Can build the vector image
+```
+
+<details>
+<summary>Testing instructions</summary>
+
+```shell
+# See the latest version at https://pypi.org/project/image-tools-stackabletech/
+pip install image-tools-stackabletech==0.0.13
+
+bake --product vector=x.y.z # where x.y.z is a valid version
+```
+
+</details>
+
+_Please consider updating this template if these instructions are wrong, or
+could be made clearer._

.github/ISSUE_TEMPLATE/update-base-stackable.md

@@ -0,0 +1,73 @@
+---
+name: Update UBI Rust Builders
+about: >-
+  This template contains instructions specific to updating this product and/or
+  container image(s).
+title: >-
+  chore(ubi-rust-builders): Update container images ahead of Stackable Release XX.(X)X
+labels: []
+# Currently, projects cannot be assigned via front-matter.
+projects: ['stackabletech/10']
+assignees: ''
+---
+
+<!--
+I don't think we should tie rust bumps to releases - they should be done as
+developers need newer versions , which could be multiple times in a release.
+If there are no bumps in a release, we can still rely on SecObserve and Renovate
+to alert us to security vulnerabilities.
+-->
+Part of #xxx.
+
+<!--
+This gives hints to the person doing the work.
+Add/Change/Remove anything that isn't applicable anymore
+-->
+- Add: `x.x.x`
+- Remove: `y.y.y`
+
+> [!TIP]
+> Please add the `scheduled-for/20XX-XX` label, and add to the [Stackable Engineering][1] project.
+>
+> [1]: https://github.com/orgs/stackabletech/projects/10
+
+```[tasklist]
+### Update tasks
+- [ ] Update UBI version hash in the Dockerfile (`FROM`)
+- [ ] Update `RUST_DEFAULT_TOOLCHAIN_VERSION`
+- [ ] Update `CARGO_CYCLONEDX_CRATE_VERSION`
+- [ ] Update `CARGO_AUDITABLE_CRATE_VERSION`
+- [ ] Update `PROTOC_VERSION`
+```
+
+```[tasklist]
+### Related Pull Requests
+- [ ] _Link to the docker-images PR (product update)_
+- [ ] _Bump rust toolchain in operator-rs_
+- [ ] _Bump rust toolchain in operator-templating_
+```
+
+This list should be completed by the assignee(s), once respective PRs have been merged. Once all items have been checked, the issue can be moved into _Development: Done_.
+
+```[tasklist]
+### Acceptance
+- Done for [ubi8-rust-builder/Dockerfile](https://github.com/stackabletech/docker-images/blob/main/ubi8-rust-builder/Dockerfile)
+- Done for [ubi9-rust-builder/Dockerfile](https://github.com/stackabletech/docker-images/blob/main/ubi9-rust-builder/Dockerfile)
+- [ ] Can build the image locally
+- [ ] Can build an operator image
+```
+
+<details>
+<summary>Testing instructions</summary>
+
+```shell
+docker build -t oci.stackable.tech/sdp/ubi9-rust-builder . -f ubi9-rust-builder/Dockerfile
+
+# Change directory into the an operator repository and ensure the image can build
+docker build . -f docker/Dockerfile
+```
+
+</details>
+
+_Please consider updating this template if these instructions are wrong, or
+could be made clearer._