Skip to content

fix: make benchmark tests resilient to CodSpeed's repeated test body execution #210

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
shenxianpeng merged 3 commits into from
Apr 7, 2026

fix: apply ruff-format to long assertion line in test_integration.py

c792a06
Select commit
Loading
Failed to load commit list.
Merged

fix: make benchmark tests resilient to CodSpeed's repeated test body execution #210

fix: apply ruff-format to long assertion line in test_integration.py
c792a06
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis succeeded Apr 7, 2026 in 0s

Performance Gate Passed

✅ 63 untouched benchmarks
🆕 25 new benchmarks
⏩ 13 skipped benchmarks1

Performance Changes

Benchmark BASE HEAD Efficiency
🆕 test_clang_format_style_from_file_with_version[22] N/A 1.1 ms N/A
🆕 test_clang_format_style_from_file_with_version[21] N/A 1.1 ms N/A
🆕 test_clang_format_style_preset_is_idempotent[Chromium] N/A 1.4 ms N/A
🆕 test_clang_format_style_preset_is_idempotent[LLVM] N/A 1.4 ms N/A
🆕 test_clang_format_style_preset_reformats_unformatted_file[Chromium] N/A 810.8 µs N/A
🆕 test_clang_format_google_style_matches_good_c N/A 809.3 µs N/A
🆕 test_clang_format_style_preset_is_idempotent[WebKit] N/A 1.4 ms N/A
🆕 test_clang_format_style_preset_is_idempotent[Google] N/A 1.4 ms N/A
🆕 test_clang_format_style_from_file_with_version[16] N/A 1.1 ms N/A
🆕 test_clang_format_style_preset_is_idempotent[Mozilla] N/A 1.4 ms N/A
🆕 test_clang_format_style_from_file_reformats N/A 812.5 µs N/A
🆕 test_clang_format_style_preset_is_idempotent[Microsoft] N/A 1.4 ms N/A
🆕 test_clang_format_style_preset_reformats_unformatted_file[LLVM] N/A 813.2 µs N/A
🆕 test_clang_format_style_from_file_with_version[19] N/A 1.1 ms N/A
🆕 test_clang_format_style_preset_reformats_unformatted_file[Google] N/A 810.8 µs N/A
🆕 test_clang_format_style_from_file_with_version[20] N/A 1.1 ms N/A
🆕 test_clang_format_style_from_file_is_idempotent N/A 1.3 ms N/A
🆕 test_clang_format_style_from_file_with_version[18] N/A 1.1 ms N/A
🆕 test_clang_format_style_from_file_with_version[17] N/A 1.1 ms N/A
🆕 test_clang_format_style_preset_reformats_unformatted_file[Microsoft] N/A 810.3 µs N/A
... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Comparing copilot/fix-issue-from-main-branch (c792a06) with main (0d4c4db)2

Open in CodSpeed

Footnotes

  1. 13 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. No successful run was found on main (dedddc3) during the generation of this report, so 0d4c4db was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

View more details on CodSpeed HQ