Skip to content

Fix report build script#1437

Merged
AustinBenoit merged 3 commits intomainfrom
fix_report_build_script
Apr 22, 2026
Merged

Fix report build script#1437
AustinBenoit merged 3 commits intomainfrom
fix_report_build_script

Conversation

@AustinBenoit
Copy link
Copy Markdown
Contributor

Description

Provide details of the change, and generalize the change in the PR title above.

Problem: The nightly integration test reporting script (report_build_status.py) was incorrectly marking successful test runs (specifically the "Test Build" and "Firestore Test Build" columns) as failures.

This happened due to a combination of two issues:

Missing Combined Artifact: The summarize-results job in integration_tests.yml downloaded and merged all the fragmented build_and_test_results-* artifacts, but it never uploaded the final combined build_and_test_results artifact. As a result, the reporting script could never find the artifact and was forced to parse the raw GitHub text logs instead.
Aggressive Fallback Logic: When parsing the raw logs of a fully successful run, the INTEGRATION TEST FAILURES block is naturally absent. Instead of recognizing the run as successful, the fallback logic incorrectly assumed the summary string was missing and injected a generic [BUILD] [ERROR] Unknown Error string, which was then parsed as a hard failure.
Solution:

integration_tests.yml: Added an actions/upload-artifact step to upload the combined build_and_test_results artifact at the end of the summarize-results job. This allows the reporting script to bypass text log scraping and parse the structured JSON directly (which is significantly faster and more reliable).
report_build_status.py: Updated the fallback logic to check if the workflow run's conclusion is


Testing

Describe how you've tested these changes.

Ran test to make sure they don't break


Type of Change

Place an x the applicable box:

  • Bug fix. Add the issue # below if applicable.
  • New feature. A non-breaking change which adds functionality.
  • Other, such as a build process or documentation change.

1. Check run conclusion before defaulting to unknown error when log parsing fails

2. Upload combined build_and_test_results artifact so report script can find it
@AustinBenoit AustinBenoit added the tests-requested: quick Trigger a quick set of integration tests. label Apr 22, 2026
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the build status reporting script to correctly identify successful integration tests even when specific failure log patterns are not found, provided the run conclusion is 'success'. A review comment suggests simplifying the implementation by removing redundant variable assignments and adding logging to maintain consistency with other parts of the script.

Comment thread scripts/gha/report_build_status.py
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
@github-actions github-actions Bot added tests: in-progress This PR's integration tests are in progress. and removed tests-requested: quick Trigger a quick set of integration tests. labels Apr 22, 2026
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 22, 2026

✅  Integration test succeeded!

Requested by @firebase-workflow-trigger[bot] on commit c702a19
Last updated: Wed Apr 22 11:05 PDT 2026
View integration test log & download artifacts

@github-actions github-actions Bot added the tests: succeeded This PR's integration tests succeeded. label Apr 22, 2026
@firebase-workflow-trigger firebase-workflow-trigger Bot removed the tests: in-progress This PR's integration tests are in progress. label Apr 22, 2026
@AustinBenoit AustinBenoit merged commit 79706f4 into main Apr 22, 2026
16 of 17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tests: succeeded This PR's integration tests succeeded.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants