Skip to content

build: parallelize repository readiness checks#7018

Closed
diegomarquezp wants to merge 1 commit into
mainfrom
parallelize-scripts
Closed

build: parallelize repository readiness checks#7018
diegomarquezp wants to merge 1 commit into
mainfrom
parallelize-scripts

Conversation

@diegomarquezp
Copy link
Copy Markdown
Contributor

@diegomarquezp diegomarquezp commented May 2, 2025

Allows to run both scripts faster:

  • clone_repositories: 30s
  • check_status: 30s

Clone repositories was enhanced with sparse-checkout.

@diegomarquezp diegomarquezp requested a review from a team May 2, 2025 14:54
@product-auto-label product-auto-label Bot added the size: m Pull request size is medium. label May 2, 2025
@suztomo
Copy link
Copy Markdown
Member

suztomo commented May 2, 2025

Be careful. Concurrency increases complexity.

clone_repositories.sh is needed only once.

I ran check_status.sh in this pull request, but it didn't seem to work.

suztomo@suztomo:~/java-cloud-bom/tests/release-repository-readiness$ sh check_status.sh 
+ WORK_DIR=/tmp/release-readiness
+ [[ ! -d /tmp/release-readiness/sdk-platform-java ]]
+ cd /tmp/release-readiness/sdk-platform-java
+ wait
++ mvn -pl java-shared-dependencies help:evaluate -Dexpression=project.version -q -DforceStdout
++ mvn -pl gapic-generator-java help:evaluate -Dexpression=project.version -q -DforceStdout
+ expected_shared_deps_version=3.46.2
+ expected_generator_version=2.56.2
+ echo 'Expected google-cloud-shared-dependencies BOM version: '
Expected google-cloud-shared-dependencies BOM version: 
+ echo 'Expected GAPIC generator Java version: '
Expected GAPIC generator Java version: 
++ mktemp
+ tmp_file=/tmp/tmp.T8KMSVoVlY
+ echo ',        main,      released'
+ awk -F, '{printf "%-20s|%-21s|%-21s|\n", $1, $2, $3}'
+ echo '    repository,shared dep,code gen,shared dep,code gen'
+ awk -F, '{printf "%-20s|%-10s|%-10s|%-10s|%-10s|\n", $1, $2, $3, $4, $5}'
+ repositories=/tmp/release-readiness/google-cloud-java
+ for repo_folder in $repositories
+ wait
+ run_check /tmp/release-readiness/google-cloud-java
+ repo_folder=/tmp/release-readiness/google-cloud-java
+ cd /tmp/release-readiness/google-cloud-java
++ basename /tmp/release-readiness/google-cloud-java
+ repo=google-cloud-java
+ git fetch -q origin main
+ git checkout -q main
remote: Enumerating objects: 1277, done.
remote: Counting objects: 100% (1277/1277), done.
remote: Compressing objects: 100% (32/32), done.
remote: Total 1277 (delta 1254), reused 1251 (delta 1244), pack-reused 0 (from 0)
Receiving objects: 100% (1277/1277), 1.13 MiB | 3.15 MiB/s, done.
Resolving deltas: 100% (1254/1254), done.
+ git pull -q origin main
+ [[ google-cloud-java == \g\o\o\g\l\e\-\c\l\o\u\d\-\j\a\v\a ]]
+ project=google-cloud-pom-parent
+ parset 'shared_deps_status_main generated_code_status_main last_release_tag' ::: 'check_shared_dependency_status "google-cloud-pom-parent"' check_generated_code_status 'gh release list --limit 1 --order desc --json '\''tagName'\'' --jq '\''.[].tagName'\'''
check_status.sh: line 64: parset: command not found
+ cat /tmp/tmp.T8KMSVoVlY
+ sort
                    |        main         |      released       |
    repository      |shared dep|code gen  |shared dep|code gen  |
suztomo@suztomo:~/java-cloud-bom/tests/release-repository-readiness$ 

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size: m Pull request size is medium.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants