Merge branch 'main-1.15' into merge-1.15.0-rc2

Author: teoincontatto

.gitlab-ci.yml

@@ -1,7 +1,7 @@
 image: null
 
 variables:
-  SG_CI_IMAGE_NAME: "ci:1.29"
+  SG_CI_IMAGE_NAME: "ci:1.30"
   BUILDER_IMAGE_NAME: "builder:1.9"
   SKIP_NATIVE: "false"
   SKIP_E2E: "false"

.gitlab/issue_templates/Beta Release.md

@@ -50,7 +50,7 @@ sh stackgres-k8s/ci/utils/generate-release-template.sh $VERSION
      ```
      # Remember to create a key pair called gitlab-runner in the target AWS region
      AMI="$(aws ssm get-parameters --names /aws/service/ami-amazon-linux-latest/amzn2-ami-hvm-arm64-gp2 --query "Parameters[].Value" --output text)"
-     curl -s https://gitlab.com/snippets/1985684/raw | bash -s -- -r "glpat-CrykSN35Lymqo1UCJDUx" -t m6gd.4xlarge -i "" -d 14400 -df internal -dp /dev/nvme1n1 -rn army-builder -tl 'docker-junit-extension-runner, oci-image, ongresinc, stackgres-maven-runner, stackgres-native-build-runner, stackgres-quarkus-test-runner, stackgres-runner-v2, linux-arm64, stackgres-e2e-runner'
+     curl -s https://gitlab.com/snippets/1985684/raw | bash -s -- -r "glpat-BkmNTE69g2-4cuS2Qkv4" -t m6gd.4xlarge -i "" -d 14400 -df internal -dp /dev/nvme1n1 -rn army-builder -tl 'docker-junit-extension-runner, oci-image, ongresinc, stackgres-maven-runner, stackgres-native-build-runner, stackgres-quarkus-test-runner, stackgres-runner-v2, linux-arm64, stackgres-e2e-runner'
      ```
 
      Now we can push `release-1.15.0-beta1` branch and wait for the pipeline to complete:

.gitlab/issue_templates/GA Release.md

@@ -50,7 +50,7 @@ sh stackgres-k8s/ci/utils/generate-release-template.sh $VERSION
      ```
      # Remember to create a key pair called gitlab-runner in the target AWS region
      AMI="$(aws ssm get-parameters --names /aws/service/ami-amazon-linux-latest/amzn2-ami-hvm-arm64-gp2 --query "Parameters[].Value" --output text)"
-     curl -s https://gitlab.com/snippets/1985684/raw | bash -s -- -r "glpat-CrykSN35Lymqo1UCJDUx" -t m6gd.4xlarge -i "" -d 14400 -df internal -dp /dev/nvme1n1 -rn army-builder -tl 'docker-junit-extension-runner, oci-image, ongresinc, stackgres-maven-runner, stackgres-native-build-runner, stackgres-quarkus-test-runner, stackgres-runner-v2, linux-arm64, stackgres-e2e-runner'
+     curl -s https://gitlab.com/snippets/1985684/raw | bash -s -- -r "glpat-BkmNTE69g2-4cuS2Qkv4" -t m6gd.4xlarge -i "" -d 14400 -df internal -dp /dev/nvme1n1 -rn army-builder -tl 'docker-junit-extension-runner, oci-image, ongresinc, stackgres-maven-runner, stackgres-native-build-runner, stackgres-quarkus-test-runner, stackgres-runner-v2, linux-arm64, stackgres-e2e-runner'
      ```
 
      Now we can push `release-1.15.0` branch and wait for the pipeline to complete:

.gitlab/issue_templates/RC Release.md

@@ -1,3 +1,64 @@
+# :rocket: Release 1.15.0-rc2 (2024-12-11)
+
+## :notepad_spiral: NOTES
+
+StackGres 1.15.0-rc2 has been released! :confetti_ball: :champagne: 
+
+This release brings support for Patroni 4 that include some cool features like "Quorum-based failover" or "Register Citus secondaries in pg_dist_node" but also many bugfixes.
+
+Another important change is the new SGDistributedLogs that after the upgrade will generate an SGCluster. This change allow to use SGDbOps in order to perform restart, security upgrade, minor version and major version upgrades operations.
+
+Performance and responsiveness have been improved by allowing to reconcile StackGres custom resources in parallel with a queue that gives priority to reconciliation of StackGres custom resources that receive changes. This should improve the use cases with many StackGres custom resources.
+
+So, what you are waiting for to try this release and have a look to the future of StackGres! 
+
+## :sparkles: NEW FEATURES AND CHANGES
+
+* Support for Patroni 4.0.4
+* Support for Postgres 17.2, 16.6, 15.10, 14.15, 13.18 and 12.22
+* Envoy 1.32.1
+* Prometheus Postgres Exporter 0.16.0
+* Fluent-bit 3.2.1
+* OTEL Collector 0.114.0
+* Make SGDistributedLogs generate an SGCluster
+* Support for headless service
+* Improve performance and responsiveness
+* Allow to disable Envoy
+
+## Web Console
+
+Nothing new here! :eyes:
+
+## :bug: FIXES
+
+* Make int-or-string fields real int-or-string and not just string fields
+* Allow to rollback upgrade when CHECKPOINT fail
+* SGScript and SGCluster script entry version are resetted to 0 if part of a reconciliation of another CR
+* SGShardedCluster metrics are not collected by default
+
+## Web Console
+
+Nothing new here! :eyes:
+
+## :construction: KNOWN ISSUES
+
+* Backups may be restored with inconsistencies when performed with a Postgres instance running on a different architecture ([#1539](https://gitlab.com/ongresinc/stackgres/-/issues/1539))
+
+## :up: UPGRADE
+
+To upgrade from a previous installation of the StackGres operator's helm chart you will have to upgrade the helm chart release.
+ For more detailed information please refer to [our documentation](https://stackgres.io/doc/latest/install/helm/upgrade/#upgrade-operator).
+
+To upgrade StackGres operator's (upgrade only works starting from 1.1 version or above) helm chart issue the following commands (replace namespace and release name if you used something different):
+
+`helm upgrade -n "stackgres" "stackgres-operator" https://stackgres.io/downloads/stackgres-k8s/stackgres/1.15.0-rc1/helm/stackgres-operator.tgz`
+
+> IMPORTANT: This release is incompatible with previous `alpha` or `beta` versions. Upgrading from those versions will require uninstalling completely StackGres including all clusters and StackGres CRDs (those in `stackgres.io` group) first.
+
+Thank you for all the issues created, ideas, and code contributions by the StackGres Community!
+
+## :twisted_rightwards_arrows: [FULL LIST OF COMMITS](https://gitlab.com/ongresinc/stackgres/-/commits/1.15.0-rc2)
+
 # :rocket: Release 1.15.0-rc1 (2024-12-04)
 
 ## :notepad_spiral: NOTES

CHANGELOG.md

@@ -10,6 +10,7 @@ find "$(dirname "$0")/../stackgres-k8s/src/common/src/main/resources/crds" -name
       cp "$FILE" "$(dirname "$0")/data/crds"
     done
 cp "$(dirname "$0")/../stackgres-k8s/install/helm/stackgres-operator/Chart.yaml" "$(dirname "$0")/data/stackgres_operator_Chart.yaml"
+sed -n 's#^ *RUN wget "https://get.helm.sh/helm-v\([^-]\+\)-.*$#version: \1#p' "$(dirname "$0")/../stackgres-k8s/ci/build/Dockerfile-ci" > "$(dirname "$0")/data/helm_version.yaml"
 
 STACKGRES_VERSION="${STACKGRES_VERSION:-$(sh stackgres-k8s/ci/build/version.sh)}"
 echo "current_version: \"$STACKGRES_VERSION\"" > "$(dirname "$0")/data/versions.yml"
@@ -51,7 +52,7 @@ helm-docs \
 )
 mv "$(dirname "$0")/../stackgres-k8s/install/helm/stackgres-operator/generated.md" \
   "$(dirname "$0")/generated/stackgres-operator.md"
-TARGET_PATH="$(dirname "$0")/../doc/content/en/04-administration-guide/01-stackgres-installation/02-installation-via-helm/01-operator-parameters"
+TARGET_PATH="$(dirname "$0")/../doc/content/en/04-administration-guide/01-installation/02-installation-via-helm/01-operator-parameters"
 INCLUDE_LINE="$(cat "$TARGET_PATH/_index.template.md" | grep -nxF '{{% include "generated/stackgres-operator.md" %}}' | cut -d : -f 1)"
 head -n "$((INCLUDE_LINE - 1))" "$TARGET_PATH/_index.template.md" > "$TARGET_PATH/_index.md"
 cat "$(dirname "$0")/generated/stackgres-operator.md" >> "$TARGET_PATH/_index.md"

doc/build.sh

@@ -155,7 +155,7 @@ and integrates as a sidecar offering an auto binding mechanism if Prometheus is
 Please take into account that Prometheus is an external dependency and that StackGres expects that you install and configure it separately.
 
 Of course, StackGres provides an option to deploy Prometheus alongside the StackGres Operator
-as part of the [Helm chart]({{% relref "04-administration-guide/01-stackgres-installation/02-installation-via-helm" %}})
+as part of the [Helm chart]({{% relref "04-administration-guide/01-installation/02-installation-via-helm" %}})
 and you can follow the steps described there to set the required parameters so that the monitoring integration works as expected.
 Please read and review the steps and notes for a successful installation.
 
@@ -169,8 +169,8 @@ By default, the [Prometheus Operator](https://github.com/coreos/prometheus-opera
 
 StackGres includes two ways:
 
-- [Automatic integration]({{% relref "/04-administration-guide/01-stackgres-installation/01-pre-requisites/#integrating-pre-existing-grafanas" %}})
-- [Manual integration]({{% relref "/04-administration-guide/01-stackgres-installation/01-pre-requisites/#manual-integration" %}})
+- [Automatic integration]({{% relref "/04-administration-guide/01-installation/01-pre-requisites/#integrating-pre-existing-grafanas" %}})
+- [Manual integration]({{% relref "/04-administration-guide/01-installation/01-pre-requisites/#manual-integration" %}})
 
 Some manual steps are required in order to achieve such integration.
 

doc/content/en/01-introduction/03-architecture/01-components-of-the-stack/_index.md

@@ -8,6 +8,30 @@ showToc: true
 
 =======
 
+## StackGres 1.15.0-rc2
+
+| Component | Versions |
+| ------ | ----------- |
+| PostgreSQL 17 | 17.2, 17.0 |
+| PostgreSQL 16 | 16.6, 16.4, 16.3, 16.2, 16.1, 16.0 |
+| PostgreSQL 15 | 15.10, 15.8, 15.7, 15.6, 15.5, 15.4, 15.3, 15.2, 15.1, 15.0 |
+| PostgreSQL 14 | 14.15, 14.13, 14.12, 14.11, 14.10, 14.9, 14.8, 14.7, 14.6, 14.5, 14.4, ~14.2, 14.1, 14.0~ |
+| PostgreSQL 13 | 13.18, 13.16 13.15, 13.14, 13.13, 13.12, 13.11, 13.10, 13.9, 13.8, 13.7, 13.6, 13.5, 13.4, 13.3, 13.2, 13.1, 13.0 |
+| PostgreSQL 12 | 12.22, 12.20, 12.19, 12.18, 12.17, 12.16, 12.15, 12.14, 12.13, 12.12, 12.11, 12.10, 12.9, 12.8, 12.7, 12.6, 12.5, 12.4, 12.3, 12.2 and 12.1 |
+| PostgreSQL for Babelfish 16 | 16.4, 16.2, 16.1 |
+| PostgreSQL for Babelfish 15 | 15.8, 15.5 |
+| PostgreSQL for Babelfish 14 | 14.11, 14.10, 14.3 |
+| PostgreSQL for Babelfish 13 | 13.9, 13.6 |
+| Patroni | 4.0.4, 3.3.3, 3.3.2, 3.3.0, 3.2.2, 3.0.2, 2.1.4 |
+| WAL-G | 3.0.3, 3.0.2, 3.0.1, 2.0.1, 2.0.0, 1.1 |
+| PgBouncer | 1.23.1 |
+| Postgres Exporter | 0.16.0 |
+| Envoy | 1.32.1 |
+| Fluent-Bit | 3.2.1 |
+| Fluentd | 1.17.1 |
+| Babelfish Compass | 2024.10b |
+| OTEL Collector | 0.114.0 |
+
 ## StackGres 1.15.0-rc1
 
 | Component | Versions |

doc/content/en/01-introduction/06-versions/_index.md

@@ -13,17 +13,22 @@ aliases: [ /demo/quickstart ]
 On this page, you will learn how to get started with StackGres.
 We will install StackGres on a Kubernetes cluster and create a Postgres instance.
 
-> **NOTE:** To run this demo you need a [K8s environment]({{% relref "04-administration-guide/01-stackgres-installation/01-pre-requisites/01-k8s-environments" %}}) that is already configured in `kubectl`.
+> **NOTE:** To run this demo you need a [K8s environment]({{% relref "04-administration-guide/01-installation/01-pre-requisites" %}}) with `kubectl` command already configured to use it. You will also need [`helm`](https://helm.sh/) command version >= `{{% helm-min-version %}}`.
+
+## Set Up the Helm Repository
+
+Add the StackGres Helm repository:
+
+```
+helm repo add stackgres-charts https://stackgres.io/downloads/stackgres-k8s/stackgres/helm/
+```
 
 ## Installing the Operator
 
-We ship some Kubernetes resources files in order to allow installation of the StackGres operator
- for demonstration purpose. Assuming you have already installed the
- [kubectl CLI](https://kubernetes.io/docs/tasks/tools/install-kubectl/), you can install the
- operator with the following command:
+Install the operator using the following command: 
 
 ```
-kubectl create -f {{< download-url >}}/stackgres-operator-demo.yml
+helm install --create-namespace --namespace stackgres stackgres-operator stackgres-charts/stackgres-operator --version {{< version >}}
 ```
 
 This will install all required resources, and add the StackGres operator to a new namespace `stackgres`.
@@ -151,10 +156,9 @@ Then you can open the browser at the following address [`localhost:8443/admin/`]
 ## Cleaning up
 
 To uninstall all resources generated by this demo, you can run:
+
 ```
-kubectl delete --ignore-not-found -f {{< download-url >}}/stackgres-operator-demo.yml
+helm uninstall --namespace stackgres stackgres-operator
 ```
 
 Check the [uninstall]({{% relref "/04-administration-guide/999999-uninstall" %}}) section for more details.
-
-Also, see the [installation via helm]({{% relref "/04-administration-guide/01-stackgres-installation/02-installation-via-helm" %}}) section in order to change those.