Skip to content

chore: run test coverage improver twice daily#3280

Merged
lpcox merged 2 commits into
mainfrom
chore/test-improver-twice-daily
May 16, 2026
Merged

chore: run test coverage improver twice daily#3280
lpcox merged 2 commits into
mainfrom
chore/test-improver-twice-daily

Conversation

@lpcox
Copy link
Copy Markdown
Collaborator

@lpcox lpcox commented May 16, 2026

Changes the test-coverage-improver workflow schedule from weekly to twice daily (8am and 8pm UTC) to accelerate test coverage improvements across the codebase.

Changes

  • test-coverage-improver.md: schedule: weeklycron: '0 8,20 * * *'
  • test-coverage-improver.lock.yml: Recompiled with updated schedule

The skip-if-match guard (max 1 open [Test Coverage] PR) prevents pileup.

Change schedule from weekly to cron '0 8,20 * * *' to accelerate
test coverage improvements across the codebase.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@lpcox lpcox requested a review from Mossaka as a code owner May 16, 2026 22:55
Copilot AI review requested due to automatic review settings May 16, 2026 22:55
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the Test Coverage Improver agentic workflow cadence to run twice daily (08:00 and 20:00 UTC) instead of weekly, to accelerate coverage-improvement PR generation while relying on the existing skip-if-match guard to prevent PR pileup.

Changes:

  • Updated workflow schedule in the source workflow markdown to cron: '0 8,20 * * *'.
  • Recompiled the generated lock workflow YAML to reflect the new schedule.
Show a summary per file
File Description
.github/workflows/test-coverage-improver.md Changes the workflow schedule from weekly to twice daily.
.github/workflows/test-coverage-improver.lock.yml Updates the compiled/locked workflow to match the new cron schedule.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 2/2 changed files
  • Comments generated: 2

Comment on lines 5 to +9
container security, and domain validation - the core security components of the firewall.

on:
schedule: weekly
schedule:
- cron: '0 8,20 * * *'
Comment on lines +53 to +56
name: "Weekly Test Coverage Improver"
"on":
schedule:
- cron: "49 9 * * 0"
# Friendly format: weekly (scattered)
- cron: "0 8,20 * * *"
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

- Rename 'Weekly Test Coverage Improver' to 'Test Coverage Improver'
  (description, heading, and lock file name/run-name)
- Add explicit 'Do Not' rule: no sudo or awf CLI usage inside sandbox
  (addresses agent hallucinating 'sudo awf' in run #25974930350)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test Results

❌ GitHub API: Failed (HTTP 401 authentication issue)
✅ Playwright: Passed (page title contains GitHub)
✅ File verify: Passed (smoke-test file readable)

Overall: FAIL — 2/3 tests passed. GitHub API authentication failure blocks PR listing test.

💥 [THE END] — Illustrated by Smoke Claude

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test: Copilot BYOK (Offline) Mode

Test Result
GitHub MCP connectivity ❌ (401 — MCP not authenticated in this environment)
GitHub.com HTTP connectivity ⚠️ (pre-step data not available — template vars unexpanded)
File write/read ⚠️ (pre-step data not available — template vars unexpanded)
BYOK inference (api-proxy → api.githubcopilot.com)

Running in BYOK offline mode (COPILOT_OFFLINE=true) via api-proxy → api.githubcopilot.com.

Overall: PARTIAL — BYOK inference path confirmed working; pre-computed step outputs were not injected into the prompt (template variables unexpanded), preventing full validation.

🔑 BYOK report filed by Smoke Copilot BYOK

@github-actions
Copy link
Copy Markdown
Contributor

🔍 Smoke Test Results

Test Result
GitHub MCP connectivity ❌ 401 Bad credentials
GitHub.com HTTP connectivity ⚠️ Template variable unresolved
File write/read (smoke-test-copilot-25975538569.txt) ✅ Confirmed

Overall: FAIL

MCP authentication is unavailable in this environment. File I/O test passed.

📰 BREAKING: Report filed by Smoke Copilot

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test Results

  • GitHub MCP Testing: ✅
  • GitHub.com Connectivity: ✅
  • File Writing Testing: ✅
  • Bash Tool Testing: ✅

Overall Status: PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • localhost

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "localhost"

See Network Configuration for more information.

💎 Faceted by Smoke Gemini

@github-actions
Copy link
Copy Markdown
Contributor

🏗️ Build Test Suite Results

Ecosystem Project Build/Install Tests Status
Bun elysia 1/1 passed ✅ PASS
Bun hono 1/1 passed ✅ PASS
C++ fmt N/A ✅ PASS
C++ json N/A ✅ PASS
Deno oak N/A 1/1 passed ✅ PASS
Deno std N/A 1/1 passed ✅ PASS
.NET hello-world N/A ✅ PASS
.NET json-parse N/A ✅ PASS
Go color 1/1 passed ✅ PASS
Go env 1/1 passed ✅ PASS
Go uuid 1/1 passed ✅ PASS
Java gson 1/1 passed ✅ PASS
Java caffeine 1/1 passed ✅ PASS
Node.js clsx passed ✅ PASS
Node.js execa passed ✅ PASS
Node.js p-limit passed ✅ PASS
Rust fd 1/1 passed ✅ PASS
Rust zoxide 1/1 passed ✅ PASS

Overall: 8/8 ecosystems passed — ✅ PASS

Generated by Build Test Suite for issue #3280 · ● 4.4M ·

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test Results — Services Connectivity

Check Result
Redis PING ❌ timeout/no response
PostgreSQL pg_isready ❌ no response
PostgreSQL SELECT 1 ❌ no response

Overall: FAILhost.docker.internal is unreachable on ports 6379 and 5432. Service containers do not appear to be running or accessible in this environment.

🔌 Service connectivity validated by Smoke Services

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test: Codex

  • PRs: refactor(services): deduplicate container security-hardening config across sidecar builders; refactor(api-proxy): deduplicate null tool_call type normalization
  • GitHub PR review/query: ❌ safe input unavailable; curl fallback worked
  • Playwright/title, file/bash, build: ✅
  • Tavily/discussion: ❌ unavailable tools
  • Overall status: FAIL

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • registry.npmjs.org

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "registry.npmjs.org"

See Network Configuration for more information.

🔮 The oracle has spoken through Smoke Codex

@lpcox lpcox merged commit afe7600 into main May 16, 2026
62 of 65 checks passed
@lpcox lpcox deleted the chore/test-improver-twice-daily branch May 16, 2026 23:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants