Skip to content

[DX-3567] save price provider logs to a file#21634

Merged
Tofel merged 6 commits intodevelopfrom
reduce-cre-soak-test-noise
Mar 26, 2026
Merged

[DX-3567] save price provider logs to a file#21634
Tofel merged 6 commits intodevelopfrom
reduce-cre-soak-test-noise

Conversation

@Tofel
Copy link
Copy Markdown
Contributor

@Tofel Tofel commented Mar 23, 2026

Why? Otherwise price provider creates so much noise it crashes GIthub's UI.

Test execution: https://github.com/smartcontractkit/chainlink/actions/runs/23501384861/job/68397092504

Also: use more powerful runner.

Last, but not least... that memory leak test now completes, but fails, because memory usage is way above the threshold.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 23, 2026

✅ No conflicts with other open PRs targeting develop

@trunk-io
Copy link
Copy Markdown

trunk-io Bot commented Mar 23, 2026

Static BadgeStatic BadgeStatic BadgeStatic Badge

View Full Report ↗︎Docs

@Tofel Tofel marked this pull request as ready for review March 25, 2026 09:11
@Tofel Tofel requested review from a team as code owners March 25, 2026 09:11
Copilot AI review requested due to automatic review settings March 25, 2026 09:11
@Tofel Tofel changed the title use sampling logger for CRE soak test save price provider logs to a file Mar 25, 2026
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Risk Rating: MEDIUM

This PR reduces log volume/noise during the CRE PoR memory-leak soak test by redirecting the fake price provider’s logs away from GitHub Actions stdout, and adjusts the CI workflow runner configuration for the soak job.

Changes:

  • Redirect fake price provider logs to a dedicated log file via a separate zerolog logger.
  • Increase the runner resources for the soak workflow job.
  • Gate the “Enable S3 Cache” step behind an env-var presence check.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.

File Description
system-tests/tests/soak/cre/soak_test.go Adds a dedicated logger that writes fake price provider logs to ./logs/soak-fake-price-provider.log and passes it into the soak price provider.
.github/workflows/cre-soak-memory-leak.yml Updates runner sizing for the soak job and conditionally runs the S3 cache enabling step.

Scrupulous human review suggested for:

  • The new log file path/creation behavior and whether artifacts capture the redirected logs as intended.
  • The workflow runner sizing change (availability/cost/queue impact).

Suggested reviewers (per CODEOWNERS):

  • For .github/workflows/**: @smartcontractkit/devex-cicd, @smartcontractkit/devex-tooling, @smartcontractkit/core
  • For system-tests/** (falls back to repo root owners): @smartcontractkit/foundations, @smartcontractkit/core

Comment thread system-tests/tests/soak/cre/soak_test.go
Comment thread system-tests/tests/soak/cre/soak_test.go Outdated
Comment thread system-tests/tests/soak/cre/soak_test.go Outdated
kdihalas
kdihalas previously approved these changes Mar 25, 2026
pavel-raykov
pavel-raykov previously approved these changes Mar 25, 2026
@Tofel Tofel dismissed stale reviews from pavel-raykov and kdihalas via 5003590 March 25, 2026 12:00
@cl-sonarqube-production
Copy link
Copy Markdown

@Tofel Tofel changed the title save price provider logs to a file [DX-3567] save price provider logs to a file Mar 25, 2026
@Tofel Tofel enabled auto-merge March 25, 2026 12:22
@Tofel Tofel requested review from kdihalas and pavel-raykov March 25, 2026 12:23
@Tofel Tofel added this pull request to the merge queue Mar 26, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Mar 26, 2026
@Tofel Tofel added this pull request to the merge queue Mar 26, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Mar 26, 2026
@Tofel Tofel added this pull request to the merge queue Mar 26, 2026
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Mar 26, 2026
@Tofel Tofel added this pull request to the merge queue Mar 26, 2026
Merged via the queue into develop with commit 7fc8237 Mar 26, 2026
128 of 129 checks passed
@Tofel Tofel deleted the reduce-cre-soak-test-noise branch March 26, 2026 17:10
prashantkumar1982 pushed a commit that referenced this pull request Apr 2, 2026
* use sampling logger for CRE soak test

* throw more HDD at the runner, save fake data provider logs to a file

* add debug to runs-on, use more powerful runner

* redirect Gin output to log file

* do not close the log file on test clean up as gin writes to it after the clean up
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants