Skip to content

test(init): regression test for only-Tracing blurb bug#983

Merged
betegon merged 1 commit into
mainfrom
fix/feature-blurbs-regression
May 20, 2026
Merged

test(init): regression test for only-Tracing blurb bug#983
betegon merged 1 commit into
mainfrom
fix/feature-blurbs-regression

Conversation

@betegon
Copy link
Copy Markdown
Member

@betegon betegon commented May 20, 2026

Summary

After #982 landed, sentry init showed only "Tracing" in the blurbs table regardless of which features were enabled. The root cause was server-side (fixed in getsentry/cli-init-api#159) — the LLM was echoing human-readable labels ("Error Monitoring") in the feature field instead of canonical IDs ("errorMonitoring"), so the CLI Map lookup only found the one entry that happened to match (performanceMonitoring → "Tracing").

This PR adds a CLI-side regression test that documents the fix and guards against a recurrence: verifies all blurbs render when the server returns canonical feature IDs.

Test Plan

bun test test/lib/init/formatters.test.ts — new test passes.

Documents the fix: the LLM was echoing human-readable labels in the
feature field instead of canonical IDs, so only performanceMonitoring
(Tracing) matched the Map lookup. The server-side fix maps blurbs
positionally so canonical IDs are guaranteed. This test verifies all
blurbs render when the server returns canonical IDs correctly.

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
@github-actions
Copy link
Copy Markdown
Contributor

Codecov Results 📊

7012 passed | Total: 7012 | Pass Rate: 100% | Execution Time: 0ms

📊 Comparison with Base Branch

Metric Change
Total Tests 📈 +1
Passed Tests 📈 +1
Failed Tests
Skipped Tests

All tests are passing successfully.

✅ Patch coverage is 100.00%. Project has 14169 uncovered lines.
✅ Project coverage is 77.12%. Comparing base (base) to head (head).

Coverage diff
@@            Coverage Diff             @@
##          main       #PR       +/-##
==========================================
+ Coverage    77.09%    77.12%    +0.03%
==========================================
  Files          320       320         —
  Lines        61960     61937       -23
  Branches         0         0         —
==========================================
+ Hits         47768     47768         —
- Misses       14192     14169       -23
- Partials         0         0         —

Generated by Codecov Action

@betegon betegon marked this pull request as ready for review May 20, 2026 11:37
@betegon betegon merged commit 840acef into main May 20, 2026
26 checks passed
@betegon betegon deleted the fix/feature-blurbs-regression branch May 20, 2026 11:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant