Skip to content

ci: target x86-64-v3 in benchmarks workflow#12003

Open
xtqqczze wants to merge 1 commit intouutils:mainfrom
xtqqczze:x86-64-v3
Open

ci: target x86-64-v3 in benchmarks workflow#12003
xtqqczze wants to merge 1 commit intouutils:mainfrom
xtqqczze:x86-64-v3

Conversation

@xtqqczze
Copy link
Copy Markdown
Contributor

@xtqqczze xtqqczze commented Apr 26, 2026

Ubuntu 26.04 builds packages targeting x86-64-v3, so using this target for benchmarks better reflects real-world performance.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 26, 2026

GNU testsuite comparison:

GNU test failed: tests/tail/truncate. tests/tail/truncate is passing on 'main'. Maybe you have to rebase?
Skip an intermittent issue tests/cut/bounded-memory (fails in this run but passes in the 'main' branch)
Note: The gnu test tests/tail/tail-n0f is now being skipped but was previously passing.
Congrats! The gnu test tests/tail/pipe-f is now passing!

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 26, 2026

Merging this PR will improve performance by ×3.3

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 42 improved benchmarks
✅ 269 untouched benchmarks
⏩ 46 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation wc_lines_extreme_line_lengths[(100000, 200)] 1.4 ms 1.3 ms +5.68%
Simulation wc_lines_large_line_count[500000] 2.6 ms 2.5 ms +6.26%
Simulation wc_lines_variable_length[(50, 500)] 3.2 ms 3 ms +6.32%
Simulation wc_bytes_lines_synthetic[2000] 120.8 ms 113.3 ms +6.65%
Simulation wc_chars_large_line_count[100000] 713.4 µs 683 µs +4.46%
Simulation cksum_crc 16.8 ms 14.8 ms +14.04%
Simulation cksum_crc32b 13.8 ms 11.2 ms +22.93%
Simulation cksum_sha3 1.8 s 1.4 s +30.38%
Simulation cksum_default 16.8 ms 14.8 ms +13.8%
Simulation cksum_sha1 718.4 ms 657.8 ms +9.23%
Simulation cksum_shake256 1.9 s 1.4 s +29.41%
Simulation cksum_sm3 1.6 s 1.3 s +19.29%
Simulation cksum_sha2 1.8 s 1.5 s +19.35%
Simulation cksum_shake128 1.5 s 1.2 s +29.27%
Simulation cksum_sha512 1.1 s 1 s +7.25%
Simulation cksum_sha256 1.8 s 1.5 s +19.35%
Simulation cksum_sha384 1.1 s 1 s +7.25%
Simulation cksum_multiple_files 25.3 ms 22.2 ms +13.77%
Simulation cksum_raw_output 16.8 ms 14.7 ms +14.29%
Simulation cksum_sysv 48.1 ms 14.4 ms ×3.3
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing xtqqczze:x86-64-v3 (d5ba7ee) with main (5aade31)

Open in CodSpeed

Footnotes

  1. 46 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@oech3
Copy link
Copy Markdown
Contributor

oech3 commented Apr 26, 2026

This is misleading for people using binaries published at here and other distributions.

@oech3
Copy link
Copy Markdown
Contributor

oech3 commented Apr 26, 2026

I think we can replace individual binaries with v3.

@xtqqczze xtqqczze force-pushed the x86-64-v3 branch 4 times, most recently from c30a1a1 to 768f310 Compare April 27, 2026 13:12
@xtqqczze xtqqczze marked this pull request as ready for review April 27, 2026 15:49
@xtqqczze xtqqczze force-pushed the x86-64-v3 branch 2 times, most recently from 696334f to fe31b12 Compare April 27, 2026 21:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants