Merge branch 'add-version-1.17' into 'main'

Add version 1.17

Closes #2984 and #2989

See merge request ongresinc/stackgres!1668

Author: teoincontatto

.gitlab/issue_templates/RC Release.md

@@ -1,3 +1,166 @@
+# :rocket: Release 1.16.0-rc2 (2025-03-27)
+
+## :notepad_spiral: NOTES
+
+StackGres 1.16.0-rc2 has landed! :rocket: :rainbow: :sunny:
+
+Less containers is better. Now you can reduce your SGCluster's Pod to only 2 containers (and just 1 init container) if you want leaner (but with less functionalities) Pods. :muscle:
+
+A long waited functionality that changes a bit the validation of referenced resources in Webhooks. You will no more receive messages about missing resources opening the door to a much more pleasant DevOps experience. We also tried to reduce the friction with tools like ArgoCD (still not officially supported though, please, be patient :sweat_smile:) by avoiding setting the infamous caBundle and other small changes that should improve the situation. Last but not least the creation of default resources is now handled by the operator reconciliation cycle and will not be created in the Webhook as we did before.
+
+Setting a configuration parameter without having to create a separate SGPostgresConfig now is possible, but not only for Postgres configuration, we included setting directly Pod's resources, pooling and, now, you have the ability to modify postgres_exporter queries!
+
+Improvements on SGStream should allow to fix some issues and make this component more useful for CDC use cases. We wait for your feedback!
+
+Also much more functionalities and fixes where added to this release that comes strong, hoping you will enjoy it.
+
+So, what you are waiting for? Try this release and have a look at the future of StackGres!
+
+## :sparkles: NEW FEATURES AND CHANGES
+
+* Generate default configs using reconciliation cycle
+* Removed reference validation on webhook calls
+* Allow to override SGInstanceProfile, SGPostgresConfig and SGPoolingConfig
+* Support for Grafana v10 and v11
+* Support to overwrite and add postgres exporter queries
+* Allow to encrypt stored object with libsodium or OpenPGP
+* If possible choose the latest version of the extension when multiple versions are available and version is not set
+* Support for Debezium asyncronous engine in SGStream
+* Store the status of annotation signal in the PersistentVolume for SGStream
+* Set the SGStream as Completed when running with a Deployment
+* Support to update SGStream spec when locked or when maxRetries is not set (when using a Deployment).
+* Support for skipping drop of replication slot and publication on tombstone for SGStream
+* Include the node name of each Pod in the SGCluster status
+* Allow to change the operator listening port, Service port and to set hostNetwork
+* Added memory limiter and set resources for OTEL collector
+* Avoid setting caBundle in webhooks
+* Follow webhooks original ordering
+* Avoid usage of nullable in CRDs
+* Removed pgbouncer auth, setup-scripts and cluster controller init containers and merged remaining init containers
+
+## Web Console
+
+Nothing new here! :eyes:
+
+## :bug: FIXES
+
+* Extension installation permission issue
+* Patroni reset is not skipped for replicas after major version upgrade
+* Major version upgrade SGDbOps store wrong source backup path
+* Wrong original SGStream service path in webhooks
+* Separate resources cache by resource that generates them to avoid stale resources
+* Failure to apply default naming strategy when topic has not the expected prefix in SGStream
+* Can not change the shards clusters count if restored from a backup
+* Controller fails with error when pgbouncer instance is not configured properly or unavailable
+* NullPointerException in cleanupNonGarbageCollectedResources
+* SGStream uses wrong SGCluster service name
+* Prevent pg_total_relation_size from blocking WAL fetching for replicas
+* Major version upgrade fail on any error
+* SGStream source database used instead of target database
+
+## Web Console
+
+* Some properties are not checked for undefined
+
+## :construction: KNOWN ISSUES
+
+* Backups may be restored with inconsistencies when performed with a Postgres instance running on a different architecture ([#1539](https://gitlab.com/ongresinc/stackgres/-/issues/1539))
+
+## :up: UPGRADE
+
+To upgrade from a previous installation of the StackGres operator's helm chart you will have to upgrade the helm chart release.
+ For more detailed information please refer to [our documentation](https://stackgres.io/doc/latest/install/helm/upgrade/#upgrade-operator).
+
+To upgrade StackGres operator's (upgrade only works starting from 1.1 version or above) helm chart issue the following commands (replace namespace and release name if you used something different):
+
+`helm upgrade -n "stackgres" "stackgres-operator" https://stackgres.io/downloads/stackgres-k8s/stackgres/1.16.0-rc2/helm/stackgres-operator.tgz`
+
+> IMPORTANT: This release is incompatible with previous `alpha` or `beta` versions. Upgrading from those versions will require uninstalling completely StackGres including all clusters and StackGres CRDs (those in `stackgres.io` group) first.
+
+Thank you for all the issues created, ideas, and code contributions by the StackGres Community!
+
+## :twisted_rightwards_arrows: [FULL LIST OF COMMITS](https://gitlab.com/ongresinc/stackgres/-/commits/1.16.0-rc2)
+
+# :rocket: Release 1.16.0-rc1 (2025-03-19)
+
+## :notepad_spiral: NOTES
+
+StackGres 1.16.0-rc1 has landed! :rocket: :rainbow: :sunny:
+
+Less containers is better. Now you can reduce your SGCluster's Pod to only 2 containers (and just 1 init container) if you want leaner (but with less functionalities) Pods. :muscle:
+
+A long waited functionality that changes a bit the validation of referenced resources in Webhooks. You will no more receive messages about missing resources opening the door to a much more pleasant DevOps experience. We also tried to reduce the friction with tools like ArgoCD (still not officially supported though, please, be patient :sweat_smile:) by avoiding setting the infamous caBundle and other small changes that should improve the situation. Last but not least the creation of default resources is now handled by the operator reconciliation cycle and will not be created in the Webhook as we did before.
+
+Setting a configuration parameter without having to create a separate SGPostgresConfig now is possible, but not only for Postgres configuration, we included setting directly Pod's resources, pooling and, now, you have the ability to modify postgres_exporter queries!
+
+Improvements on SGStream should allow to fix some issues and make this component more useful for CDC use cases. We wait for your feedback!
+
+Also much more functionalities and fixes where added to this release that comes strong, hoping you will enjoy it.
+
+So, what you are waiting for? Try this release and have a look at the future of StackGres! 
+
+## :sparkles: NEW FEATURES AND CHANGES
+
+* Generate default configs using reconciliation cycle
+* Removed reference validation on webhook calls
+* Allow to override SGInstanceProfile, SGPostgresConfig and SGPoolingConfig
+* Support for Grafana v10 and v11
+* Support to overwrite and add postgres exporter queries
+* Allow to encrypt stored object with libsodium or OpenPGP
+* If possible choose the latest version of the extension when multiple versions are available and version is not set
+* Support for Debezium asyncronous engine in SGStream
+* Store the status of annotation signal in the PersistentVolume for SGStream
+* Set the SGStream as Completed when running with a Deployment
+* Support to update SGStream spec when locked or when maxRetries is not set (when using a Deployment).
+* Support for skipping drop of replication slot and publication on tombstone for SGStream
+* Include the node name of each Pod in the SGCluster status
+* Allow to change the operator listening port, Service port and to set hostNetwork
+* Added memory limiter and set resources for OTEL collector
+* Avoid setting caBundle in webhooks
+* Follow webhooks original ordering
+* Avoid usage of nullable in CRDs
+* Removed pgbouncer auth, setup-scripts and cluster controller init containers and merged remaining init containers
+
+## Web Console
+
+Nothing new here! :eyes:
+
+## :bug: FIXES
+
+* Extension installation permission issue
+* Patroni reset is not skipped for replicas after major version upgrade
+* Major version upgrade SGDbOps store wrong source backup path
+* Wrong original SGStream service path in webhooks
+* Separate resources cache by resource that generates them to avoid stale resources
+* Failure to apply default naming strategy when topic has not the expected prefix in SGStream
+* Can not change the shards clusters count if restored from a backup
+* Controller fails with error when pgbouncer instance is not configured properly or unavailable
+* NullPointerException in cleanupNonGarbageCollectedResources
+* SGStream uses wrong SGCluster service name
+
+## Web Console
+
+* Some properties are not checked for undefined
+
+## :construction: KNOWN ISSUES
+
+* Backups may be restored with inconsistencies when performed with a Postgres instance running on a different architecture ([#1539](https://gitlab.com/ongresinc/stackgres/-/issues/1539))
+
+## :up: UPGRADE
+
+To upgrade from a previous installation of the StackGres operator's helm chart you will have to upgrade the helm chart release.
+ For more detailed information please refer to [our documentation](https://stackgres.io/doc/latest/install/helm/upgrade/#upgrade-operator).
+
+To upgrade StackGres operator's (upgrade only works starting from 1.1 version or above) helm chart issue the following commands (replace namespace and release name if you used something different):
+
+`helm upgrade -n "stackgres" "stackgres-operator" https://stackgres.io/downloads/stackgres-k8s/stackgres/1.16.0-rc1/helm/stackgres-operator.tgz`
+
+> IMPORTANT: This release is incompatible with previous `alpha` or `beta` versions. Upgrading from those versions will require uninstalling completely StackGres including all clusters and StackGres CRDs (those in `stackgres.io` group) first.
+
+Thank you for all the issues created, ideas, and code contributions by the StackGres Community!
+
+## :twisted_rightwards_arrows: [FULL LIST OF COMMITS](https://gitlab.com/ongresinc/stackgres/-/commits/1.16.0-rc1)
+
 # :rocket: Release 1.15.2 (2025-03-06)
 
 ## :notepad_spiral: NOTES

CHANGELOG.md

@@ -8,6 +8,54 @@ showToc: true
 
 =======
 
+## StackGres 1.16.0-rc2
+
+| Component | Versions |
+| ------ | ----------- |
+| PostgreSQL 17 | 17.4, 17.2, 17.0 |
+| PostgreSQL 16 | 16.8, 16.6, 16.4, 16.3, 16.2, 16.1, 16.0 |
+| PostgreSQL 15 | 15.12, 15.10, 15.8, 15.7, 15.6, 15.5, 15.4, 15.3, 15.2, 15.1, 15.0 |
+| PostgreSQL 14 | 14.17, 14.15, 14.13, 14.12, 14.11, 14.10, 14.9, 14.8, 14.7, 14.6, 14.5, 14.4, ~14.2, 14.1, 14.0~ |
+| PostgreSQL 13 | 13.20, 13.18, 13.16 13.15, 13.14, 13.13, 13.12, 13.11, 13.10, 13.9, 13.8, 13.7, 13.6, 13.5, 13.4, 13.3, 13.2, 13.1, 13.0 |
+| PostgreSQL 12 | 12.22, 12.20, 12.19, 12.18, 12.17, 12.16, 12.15, 12.14, 12.13, 12.12, 12.11, 12.10, 12.9, 12.8, 12.7, 12.6, 12.5, 12.4, 12.3, 12.2 and 12.1 |
+| PostgreSQL for Babelfish 16 | 16.4, 16.2, 16.1 |
+| PostgreSQL for Babelfish 15 | 15.8, 15.5 |
+| PostgreSQL for Babelfish 14 | 14.11, 14.10, 14.3 |
+| PostgreSQL for Babelfish 13 | 13.9, 13.6 |
+| Patroni | 4.0.5, 4.0.4, 3.3.3, 3.3.2, 3.3.0, 3.2.2, 3.0.2, 2.1.4 |
+| WAL-G | 3.0.3, 3.0.2, 3.0.1, 2.0.1, 2.0.0, 1.1 |
+| PgBouncer | 1.24.0 |
+| Postgres Exporter | 0.17.1 |
+| Envoy | 1.33.0 |
+| Fluent-Bit | 3.2.8 |
+| Fluentd | 1.18.0 |
+| Babelfish Compass | 2024.12 |
+| OTEL Collector | 0.121.0 |
+
+## StackGres 1.16.0-rc1
+
+| Component | Versions |
+| ------ | ----------- |
+| PostgreSQL 17 | 17.4, 17.2, 17.0 |
+| PostgreSQL 16 | 16.8, 16.6, 16.4, 16.3, 16.2, 16.1, 16.0 |
+| PostgreSQL 15 | 15.12, 15.10, 15.8, 15.7, 15.6, 15.5, 15.4, 15.3, 15.2, 15.1, 15.0 |
+| PostgreSQL 14 | 14.17, 14.15, 14.13, 14.12, 14.11, 14.10, 14.9, 14.8, 14.7, 14.6, 14.5, 14.4, ~14.2, 14.1, 14.0~ |
+| PostgreSQL 13 | 13.20, 13.18, 13.16 13.15, 13.14, 13.13, 13.12, 13.11, 13.10, 13.9, 13.8, 13.7, 13.6, 13.5, 13.4, 13.3, 13.2, 13.1, 13.0 |
+| PostgreSQL 12 | 12.22, 12.20, 12.19, 12.18, 12.17, 12.16, 12.15, 12.14, 12.13, 12.12, 12.11, 12.10, 12.9, 12.8, 12.7, 12.6, 12.5, 12.4, 12.3, 12.2 and 12.1 |
+| PostgreSQL for Babelfish 16 | 16.4, 16.2, 16.1 |
+| PostgreSQL for Babelfish 15 | 15.8, 15.5 |
+| PostgreSQL for Babelfish 14 | 14.11, 14.10, 14.3 |
+| PostgreSQL for Babelfish 13 | 13.9, 13.6 |
+| Patroni | 4.0.5, 4.0.4, 3.3.3, 3.3.2, 3.3.0, 3.2.2, 3.0.2, 2.1.4 |
+| WAL-G | 3.0.3, 3.0.2, 3.0.1, 2.0.1, 2.0.0, 1.1 |
+| PgBouncer | 1.24.0 |
+| Postgres Exporter | 0.17.1 |
+| Envoy | 1.33.0 |
+| Fluent-Bit | 3.2.8 |
+| Fluentd | 1.18.0 |
+| Babelfish Compass | 2024.12 |
+| OTEL Collector | 0.121.0 |
+
 ## StackGres 1.15.2
 
 | Component | Versions |

doc/content/en/01-introduction/06-versions/_index.md

@@ -360,15 +360,15 @@ image_name() {
   local MODULE_PLATFORM="$2"
   local IMAGE_NAME
   local MODULE_PLATFORM_DEPENDENT
+  local TAG_MODULE_PLATFORM
   BUILD_HASH="$(cat stackgres-k8s/ci/build/target/build_hash)"
   MODULE_PLATFORM_DEPENDENT="$(jq -r ".modules[\"$MODULE\"].platform_dependent | . != null and ." stackgres-k8s/ci/build/target/config.json)"
   if [ "$MODULE_PLATFORM_DEPENDENT" = true ]
   then
-    MODULE_PLATFORM="${MODULE_PLATFORM:-$(get_platform)}"
+    TAG_MODULE_PLATFORM="-$(printf %s "${MODULE_PLATFORM:-$(get_platform)}" | tr '/' '-')"
   else
-    MODULE_PLATFORM=
+    TAG_MODULE_PLATFORM=
   fi
-  TAG_MODULE_PLATFORM="$(printf %s "$MODULE_PLATFORM" | tr '/' '-')"
   IMAGE_NAME="$(grep "^$MODULE=.*$TAG_MODULE_PLATFORM$" "stackgres-k8s/ci/build/target/image-hashes.$BUILD_HASH")" \
     || die "Unable to retrieve hash for module $MODULE in stackgres-k8s/ci/build/target/image-hashes.$BUILD_HASH" 1
   IMAGE_NAME="$(printf %s "$IMAGE_NAME"| cut -d = -f 2-)"
@@ -755,6 +755,27 @@ get_platform_tag_suffix() {
   get_platform | tr '/' '-'
 }
 
+get_module_hash() {
+  local MODULE="$1"
+  local MODULE_PLATFORM="$2"
+  local IMAGE_HASHES_FILE="stackgres-k8s/ci/build/target/image-hashes.$(cat stackgres-k8s/ci/build/target/build_hash)"
+  local MODULE_PLATFORM_DEPENDENT
+  local TAG_MODULE_PLATFORM
+  if ! grep -q "^${MODULE}=" "$IMAGE_HASHES_FILE"
+  then
+    >&2 echo "Module $MODULE not found"
+    return 1
+  fi
+  MODULE_PLATFORM_DEPENDENT="$(jq -r ".modules[\"$MODULE\"].platform_dependent | . != null and ." stackgres-k8s/ci/build/target/config.json)"
+  if [ "$MODULE_PLATFORM_DEPENDENT" = true ]
+  then
+    TAG_MODULE_PLATFORM="-$(printf %s "${MODULE_PLATFORM:-$(get_platform)}" | tr '/' '-')"
+  else
+    TAG_MODULE_PLATFORM=
+  fi
+  sed -n "s/^${MODULE}=.*:hash-\([^:]\+\)$TAG_MODULE_PLATFORM$/\1/p" "$IMAGE_HASHES_FILE"
+}
+
 project_hash() {
   git --git-dir "stackgres-k8s/ci/build/target/.git" rev-parse HEAD:
 }