Skip to content

chore(db): purge 21 accidentally-ingested e2e-test runs#617

Merged
Oseltamivir merged 2 commits into
masterfrom
chore/purge-e2e-test-runs
Jul 23, 2026
Merged

chore(db): purge 21 accidentally-ingested e2e-test runs#617
Oseltamivir merged 2 commits into
masterfrom
chore/purge-e2e-test-runs

Conversation

@Oseltamivir

@Oseltamivir Oseltamivir commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds 21 accidentally-ingested runs to PURGED_RUNS in run-overrides.ts. All are workflow_dispatch runs of .github/workflows/e2e-tests.yml on feature branches that leaked into production data. Found by sweeping workflow-info across all 233 data-dates and filtering names starting with e2e Test -.

Cluster A — dsv4 agentic (AMD agentx branches), 7 runs

Includes the two originally requested (29651998085, 29819261957) plus 5 earlier iterations of the same dsv4-fp4-mi355x-sglang-agentic config:

29509107670, 29512851569 (amd/agentx_dsv4_sgl_mtp_debug, 07-16) · 29651589976, 29651793829, 29651909085, 29651998085 (amd/agentx_dsv4_sgl_mtp_0717, 07-18) · 29819261957 (amd/agentx-v1.0-th-hicon, 07-21)

29819261957 is an earlier sibling of 29912027293 (purged in #616).

Cluster B — GLM-5.2 AgentX (explore/feat branches), 14 runs

Mostly labeled "unofficial"; same class as the accidentally-ingested GLM-5.2 test runs purged on 2026-07-20:

29702212452 (feat/glm52-mi325x-agentx-full-context, 07-19) · 29811350508, 29820102138 (explore/glm52-h200-agentx-pp-pareto, 07-21) · 29874235202, 29874236524, 29874237934, 29874239449, 29874240755, 29874242029, 29877960458, 29878256381, 29881040402, 29881640438, 29882624421 (explore/glm52-h200-agentx-tuning-round2, 07-21..22)

Deliberately excluded — ran on main (may be intentional)

29657732517 (GLM-5.2 FP8 MI325X 1M AgentX concurrency curve, 07-18) and 29765418393 (Experimental MiniMax-M2.7 EAGLE AgentX smoke, att5, 07-20). Left intact pending confirmation they aren't intended data — trivial to add if they should go too.

Effect on merge

.github/workflows/apply-run-overrides.yml fires on this file changing on master and runs pnpm admin:db:apply-overrides --yes, transactionally deleting each run's rows (benchmarks, server logs, run stats, evals, changelogs, agentic_trace_replay sidecars, orphaned availability), verifying the DB, then invalidating + warming the prod cache. Whole-run purges (all attempts); the entries also skip these runs on any future re-ingest.

Verification

  • All 21 confirmed via the GitHub API as e2e-tests.yml / workflow_dispatch runs on feature branches, and present in the live production API (ingested).
  • Post-edit check: 48 unique ids, my added block strictly ascending, all 21 present, the 2 main runs correctly absent.
  • pnpm lint / pnpm fmt / pnpm typecheck pass (pre-commit hook green).

Note

Low Risk
List-only change to existing purge overrides; effect is removing bad benchmark data, not altering application logic or auth.

Overview
Expands PURGED_RUNS in run-overrides.ts with 21 GitHub Actions run IDs that were accidentally ingested from feature-branch workflow_dispatch runs of the e2e tests workflow (dsv4 AgentX / GLM-5.2 AgentX experiments).

Each entry includes a dated comment noting accidental ingest during testing. No ingest or purge logic changes—only the override list grows. After merge, CI is expected to apply overrides, delete those runs’ DB rows, and block future re-ingest for the same IDs.

Reviewed by Cursor Bugbot for commit ef463f9. Bugbot is set up for automated code reviews on this repo. Configure here.

…al ingest

Both are workflow_dispatch runs of .github/workflows/e2e-tests.yml on AMD
agentx feature branches that were accidentally ingested into production:

- 29651998085 (2026-07-18, amd/agentx_dsv4_sgl_mtp_0717):
  e2e Test - dsv4-fp4-mi355x-sglang-agentic-mtp ...
- 29819261957 (2026-07-21, amd/agentx-v1.0-th-hicon):
  e2e Test - dsv4-fp4-mi355x-sglang-disagg-agentic-hicache
  (earlier sibling of 29912027293, purged in #616)

On merge, apply-run-overrides.yml deletes each run's rows (benchmarks,
agentic trace-replay sidecars, availability) from production, verifies
the DB, and refreshes the cache; the entries also skip the runs on any
future re-ingest.
@Oseltamivir
Oseltamivir requested a review from adibarra as a code owner July 23, 2026 06:58
Copilot AI review requested due to automatic review settings July 23, 2026 06:58
@vercel

vercel Bot commented Jul 23, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
inferencemax-app Ready Ready Preview, Comment Jul 23, 2026 7:11am

Request Review

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the DB ingest override configuration to purge two additional GitHub Actions runs that were accidentally ingested into production benchmark data, ensuring they’re removed from the DB and skipped on any future re-ingest.

Changes:

  • Add run 29651998085 to PURGED_RUNS (accidental e2e test ingest).
  • Add run 29819261957 to PURGED_RUNS (accidental e2e test ingest).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Extends the purge to every other ingested run of e2e-tests.yml found by
sweeping workflow-info across all data-dates. All are workflow_dispatch
runs on feature branches, none intended for production:

- 5 dsv4 agentic (amd/agentx_dsv4_sgl_mtp_debug / _0717), 2026-07-16..18
- 14 GLM-5.2 AgentX (explore/glm52-* / feat/glm52-*), 2026-07-19..22,
  mostly labeled "unofficial" — same class as the 2026-07-20 GLM-5.2 leak

Deliberately excluded: the 2 e2e runs that ran on `main`
(29657732517 GLM-5.2 concurrency curve, 29765418393 MiniMax-M2.7 EAGLE
smoke) — left intact pending confirmation they are not intentional data.
@Oseltamivir Oseltamivir changed the title chore(db): purge accidentally-ingested e2e-test runs 29651998085 & 29819261957 chore(db): purge 21 accidentally-ingested e2e-test runs Jul 23, 2026
Copilot AI review requested due to automatic review settings July 23, 2026 07:13

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.

Comment thread packages/db/src/etl/run-overrides.ts
@Oseltamivir
Oseltamivir merged commit 6bf76b0 into master Jul 23, 2026
24 checks passed
@Oseltamivir
Oseltamivir deleted the chore/purge-e2e-test-runs branch July 23, 2026 07:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants