Try making m4 dir first#1753
Conversation
BenchmarksComparisonBenchmark execution time: 2026-03-17 20:38:47 Comparing candidate commit b22126b in PR branch Found 1 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 2 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.468µs | 34.002µs ± 0.970µs | 33.563µs ± 0.039µs | 33.615µs | 36.074µs | 36.119µs | 37.343µs | 11.26% | 1.741 | 1.183 | 2.84% | 0.069µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [33.867µs; 34.136µs] or [-0.395%; +0.395%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 186.336µs | 186.615µs ± 0.138µs | 186.603µs ± 0.083µs | 186.683µs | 186.854µs | 186.983µs | 187.206µs | 0.32% | 0.931 | 1.953 | 0.07% | 0.010µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5341702.000op/s | 5358638.145op/s ± 3956.336op/s | 5358978.906op/s ± 2395.129op/s | 5361379.065op/s | 5364567.131op/s | 5365578.630op/s | 5366656.694op/s | 0.14% | -0.924 | 1.930 | 0.07% | 279.755op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.850µs | 17.925µs ± 0.039µs | 17.915µs ± 0.022µs | 17.943µs | 17.997µs | 18.031µs | 18.090µs | 0.98% | 0.978 | 1.184 | 0.22% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 55278492.114op/s | 55789791.254op/s ± 122497.384op/s | 55817601.213op/s ± 69800.649op/s | 55872249.745op/s | 55949629.542op/s | 56002075.662op/s | 56022699.079op/s | 0.37% | -0.964 | 1.135 | 0.22% | 8661.873op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.626µs | 10.764µs ± 0.048µs | 10.764µs ± 0.032µs | 10.799µs | 10.837µs | 10.856µs | 10.902µs | 1.28% | -0.121 | 0.018 | 0.44% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 91727499.835op/s | 92902507.388op/s ± 413972.772op/s | 92905470.800op/s ± 272949.269op/s | 93165597.646op/s | 93544918.823op/s | 93880128.662op/s | 94112211.701op/s | 1.30% | 0.147 | 0.029 | 0.44% | 29272.295op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [186.596µs; 186.634µs] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5358089.835op/s; 5359186.456op/s] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.919µs; 17.930µs] or [-0.030%; +0.030%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55772814.295op/s; 55806768.213op/s] or [-0.030%; +0.030%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.758µs; 10.771µs] or [-0.062%; +0.062%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [92845134.743op/s; 92959880.033op/s] or [-0.062%; +0.062%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 86.197µs | 86.379µs ± 0.178µs | 86.350µs ± 0.052µs | 86.404µs | 86.553µs | 86.994µs | 88.206µs | 2.15% | 6.520 | 58.261 | 0.21% | 0.013µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [86.355µs; 86.404µs] or [-0.029%; +0.029%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.893µs | 3.912µs ± 0.003µs | 3.912µs ± 0.002µs | 3.914µs | 3.916µs | 3.919µs | 3.920µs | 0.21% | -1.452 | 11.364 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 255076720.035op/s | 255613961.460op/s ± 177854.620op/s | 255605975.416op/s ± 111774.700op/s | 255728622.426op/s | 255843155.759op/s | 255876317.977op/s | 256876365.315op/s | 0.50% | 1.476 | 11.545 | 0.07% | 12576.221op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 80.252µs | 80.837µs ± 0.281µs | 80.808µs ± 0.194µs | 81.017µs | 81.370µs | 81.547µs | 81.631µs | 1.02% | 0.525 | -0.114 | 0.35% | 0.020µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12250280.744op/s | 12370708.617op/s ± 42939.492op/s | 12375013.012op/s ± 29718.773op/s | 12403755.572op/s | 12432582.006op/s | 12447820.265op/s | 12460698.555op/s | 0.69% | -0.508 | -0.135 | 0.35% | 3036.281op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 72.971µs | 73.467µs ± 0.259µs | 73.437µs ± 0.170µs | 73.607µs | 73.945µs | 74.167µs | 74.191µs | 1.03% | 0.565 | -0.048 | 0.35% | 0.018µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13478790.140op/s | 13611772.414op/s ± 47963.447op/s | 13617173.543op/s ± 31492.969op/s | 13648637.796op/s | 13679809.832op/s | 13699158.321op/s | 13704072.850op/s | 0.64% | -0.548 | -0.071 | 0.35% | 3391.528op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.898µs | 3.913µs ± 0.003µs | 3.912µs ± 0.002µs | 3.914µs | 3.919µs | 3.921µs | 3.923µs | 0.28% | 0.337 | 2.951 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254899990.911op/s | 255583998.092op/s ± 200471.228op/s | 255605488.390op/s ± 110567.032op/s | 255721723.536op/s | 255821536.979op/s | 255870588.654op/s | 256562218.899op/s | 0.37% | -0.325 | 2.980 | 0.08% | 14175.457op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 70.014µs | 70.547µs ± 0.251µs | 70.540µs ± 0.180µs | 70.727µs | 70.972µs | 71.111µs | 71.479µs | 1.33% | 0.446 | 0.491 | 0.36% | 0.018µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 13990140.892op/s | 14175054.419op/s ± 50376.389op/s | 14176274.587op/s ± 36306.395op/s | 14211530.881op/s | 14257322.206op/s | 14266825.026op/s | 14282801.686op/s | 0.75% | -0.422 | 0.440 | 0.35% | 3562.149op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 53.060µs | 53.129µs ± 0.036µs | 53.127µs ± 0.024µs | 53.148µs | 53.192µs | 53.232µs | 53.256µs | 0.24% | 0.700 | 0.638 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 18777393.012op/s | 18822031.806op/s ± 12839.356op/s | 18822860.157op/s ± 8581.925op/s | 18831778.118op/s | 18840184.675op/s | 18846413.221op/s | 18846524.870op/s | 0.13% | -0.696 | 0.628 | 0.07% | 907.880op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.427µs | 6.442µs ± 0.007µs | 6.441µs ± 0.004µs | 6.446µs | 6.455µs | 6.464µs | 6.467µs | 0.40% | 0.789 | 0.722 | 0.11% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 154637040.082op/s | 155234088.626op/s ± 173431.787op/s | 155250226.778op/s ± 103713.517op/s | 155352128.420op/s | 155473849.304op/s | 155507589.348op/s | 155583161.354op/s | 0.21% | -0.782 | 0.705 | 0.11% | 12263.479op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.891µs | 3.912µs ± 0.003µs | 3.912µs ± 0.002µs | 3.913µs | 3.916µs | 3.926µs | 3.928µs | 0.41% | 0.242 | 12.372 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254594960.932op/s | 255627240.293op/s ± 214946.220op/s | 255637770.482op/s ± 102717.626op/s | 255745224.949op/s | 255856227.223op/s | 255916857.820op/s | 256998379.583op/s | 0.53% | -0.206 | 12.462 | 0.08% | 15198.993op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 64.888µs | 65.142µs ± 0.134µs | 65.131µs ± 0.089µs | 65.219µs | 65.376µs | 65.639µs | 65.653µs | 0.80% | 1.164 | 2.263 | 0.21% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15231510.553op/s | 15351094.283op/s ± 31533.813op/s | 15353707.803op/s ± 21123.598op/s | 15374803.004op/s | 15389478.291op/s | 15402056.649op/s | 15411251.755op/s | 0.37% | -1.147 | 2.195 | 0.20% | 2229.777op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 58.172µs | 58.377µs ± 0.132µs | 58.348µs ± 0.070µs | 58.437µs | 58.594µs | 58.810µs | 59.090µs | 1.27% | 1.755 | 5.431 | 0.22% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 16923417.208op/s | 17130225.507op/s ± 38470.790op/s | 17138460.075op/s ± 20679.724op/s | 17155030.664op/s | 17175358.348op/s | 17187456.543op/s | 17190502.248op/s | 0.30% | -1.726 | 5.263 | 0.22% | 2720.296op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.894µs | 3.913µs ± 0.004µs | 3.912µs ± 0.002µs | 3.914µs | 3.919µs | 3.924µs | 3.936µs | 0.60% | 1.221 | 9.325 | 0.10% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254073724.902op/s | 255579226.800op/s ± 246289.063op/s | 255607533.978op/s ± 111328.162op/s | 255716404.208op/s | 255870832.162op/s | 255944651.102op/s | 256780996.640op/s | 0.46% | -1.193 | 9.252 | 0.10% | 17415.267op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 55.153µs | 55.539µs ± 0.188µs | 55.512µs ± 0.118µs | 55.645µs | 55.903µs | 56.094µs | 56.178µs | 1.20% | 0.735 | 0.746 | 0.34% | 0.013µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17800415.448op/s | 18005428.004op/s ± 60643.491op/s | 18014125.765op/s ± 38207.942op/s | 18047044.126op/s | 18090646.683op/s | 18117750.882op/s | 18131429.019op/s | 0.65% | -0.713 | 0.697 | 0.34% | 4288.142op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 53.061µs | 53.130µs ± 0.040µs | 53.127µs ± 0.026µs | 53.152µs | 53.197µs | 53.233µs | 53.304µs | 0.33% | 0.752 | 1.084 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 18760245.551op/s | 18821868.091op/s ± 14055.190op/s | 18822862.031op/s ± 9207.135op/s | 18832172.167op/s | 18840548.744op/s | 18844913.529op/s | 18846382.043op/s | 0.12% | -0.746 | 1.064 | 0.07% | 993.852op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.429µs | 6.443µs ± 0.007µs | 6.442µs ± 0.005µs | 6.447µs | 6.456µs | 6.463µs | 6.470µs | 0.43% | 0.574 | 0.325 | 0.11% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 154555475.364op/s | 155207717.401op/s ± 175391.567op/s | 155222536.194op/s ± 114712.810op/s | 155336989.630op/s | 155463058.234op/s | 155523776.319op/s | 155533190.913op/s | 0.20% | -0.567 | 0.310 | 0.11% | 12402.057op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255589312.520op/s; 255638610.400op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [80.798µs; 80.876µs] or [-0.048%; +0.048%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12364757.617op/s; 12376659.618op/s] or [-0.048%; +0.048%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [73.431µs; 73.503µs] or [-0.049%; +0.049%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13605125.141op/s; 13618419.686op/s] or [-0.049%; +0.049%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.912µs; 3.913µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255556214.708op/s; 255611781.477op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [70.513µs; 70.582µs] or [-0.049%; +0.049%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14168072.736op/s; 14182036.102op/s] or [-0.049%; +0.049%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [53.124µs; 53.134µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [18820252.395op/s; 18823811.217op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.441µs; 6.443µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [155210052.649op/s; 155258124.604op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.911µs; 3.912µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255597450.815op/s; 255657029.772op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.124µs; 65.161µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15346723.999op/s; 15355464.566op/s] or [-0.028%; +0.028%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [58.358µs; 58.395µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [17124893.826op/s; 17135557.189op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.912µs; 3.913µs] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255545093.504op/s; 255613360.095op/s] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [55.513µs; 55.565µs] or [-0.047%; +0.047%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [17997023.399op/s; 18013832.608op/s] or [-0.047%; +0.047%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [53.124µs; 53.135µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [18819920.177op/s; 18823816.005op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.442µs; 6.444µs] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [155183409.816op/s; 155232024.985op/s] or [-0.016%; +0.016%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.358µs | 2.399µs ± 0.019µs | 2.391µs ± 0.010µs | 2.414µs | 2.435µs | 2.440µs | 2.442µs | 2.14% | 0.675 | -0.595 | 0.77% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.396µs; 2.402µs] or [-0.107%; +0.107%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.138ms | 4.144ms ± 0.003ms | 4.143ms ± 0.002ms | 4.145ms | 4.148ms | 4.151ms | 4.172ms | 0.69% | 3.886 | 31.221 | 0.08% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.143ms; 4.144ms] or [-0.010%; +0.010%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | 4.173ms | 4.179ms ± 0.009ms | 4.178ms ± 0.001ms | 4.180ms | 4.182ms | 4.201ms | 4.286ms | 2.58% | 9.653 | 111.149 | 0.21% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | [4.178ms; 4.180ms] or [-0.029%; +0.029%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.214ms | 14.255ms ± 0.027ms | 14.251ms ± 0.011ms | 14.263ms | 14.287ms | 14.355ms | 14.431ms | 1.26% | 2.910 | 13.017 | 0.19% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.251ms; 14.259ms] or [-0.026%; +0.026%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.215µs | 3.247µs ± 1.447µs | 3.010µs ± 0.030µs | 3.040µs | 3.658µs | 14.267µs | 14.920µs | 395.70% | 7.301 | 54.662 | 44.46% | 0.102µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.047µs; 3.448µs] or [-6.177%; +6.177%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 495.269µs | 496.050µs ± 0.380µs | 496.011µs ± 0.233µs | 496.256µs | 496.652µs | 497.129µs | 497.575µs | 0.32% | 0.657 | 1.295 | 0.08% | 0.027µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 2009749.069op/s | 2015927.461op/s ± 1543.378op/s | 2016085.111op/s ± 948.299op/s | 2016931.015op/s | 2018363.848op/s | 2018870.789op/s | 2019102.957op/s | 0.15% | -0.650 | 1.276 | 0.08% | 109.133op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 369.716µs | 370.243µs ± 0.297µs | 370.212µs ± 0.154µs | 370.371µs | 370.689µs | 371.045µs | 372.457µs | 0.61% | 2.397 | 14.234 | 0.08% | 0.021µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2684875.571op/s | 2700927.640op/s ± 2164.465op/s | 2701151.683op/s ± 1121.090op/s | 2702187.509op/s | 2703540.514op/s | 2704287.320op/s | 2704780.712op/s | 0.13% | -2.372 | 13.998 | 0.08% | 153.051op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 168.568µs | 168.914µs ± 0.160µs | 168.894µs ± 0.107µs | 169.015µs | 169.193µs | 169.334µs | 169.538µs | 0.38% | 0.617 | 0.567 | 0.09% | 0.011µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5898397.227op/s | 5920178.912op/s ± 5613.017op/s | 5920884.046op/s ± 3747.340op/s | 5924467.313op/s | 5928365.901op/s | 5930041.500op/s | 5932312.589op/s | 0.19% | -0.611 | 0.551 | 0.09% | 396.900op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.812µs | 37.036µs ± 0.115µs | 37.051µs ± 0.095µs | 37.125µs | 37.206µs | 37.271µs | 37.322µs | 0.73% | -0.082 | -0.992 | 0.31% | 0.008µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26793727.765op/s | 27000882.814op/s ± 84125.737op/s | 26990130.201op/s ± 68858.155op/s | 27074045.211op/s | 27133167.600op/s | 27149131.721op/s | 27165032.779op/s | 0.65% | 0.091 | -0.997 | 0.31% | 5948.588op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 46.193µs | 46.299µs ± 0.053µs | 46.290µs ± 0.024µs | 46.316µs | 46.407µs | 46.460µs | 46.518µs | 0.49% | 1.135 | 1.983 | 0.12% | 0.004µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21496843.936op/s | 21598722.611op/s ± 24911.104op/s | 21603049.599op/s ± 11286.012op/s | 21612537.258op/s | 21632708.704op/s | 21644868.058op/s | 21648464.700op/s | 0.21% | -1.126 | 1.954 | 0.12% | 1761.481op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [495.997µs; 496.103µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2015713.564op/s; 2016141.358op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [370.202µs; 370.285µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2700627.666op/s; 2701227.614op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [168.892µs; 168.936µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5919401.002op/s; 5920956.822op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.020µs; 37.052µs] or [-0.043%; +0.043%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26989223.796op/s; 27012541.832op/s] or [-0.043%; +0.043%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [46.292µs; 46.307µs] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21595270.172op/s; 21602175.051op/s] or [-0.016%; +0.016%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.990µs | 5.069µs ± 0.055µs | 5.042µs ± 0.031µs | 5.108µs | 5.173µs | 5.176µs | 5.179µs | 2.71% | 0.643 | -0.872 | 1.08% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.061µs; 5.076µs] or [-0.150%; +0.150%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 159.478µs | 160.229µs ± 0.296µs | 160.192µs ± 0.133µs | 160.345µs | 160.716µs | 161.127µs | 161.879µs | 1.05% | 1.464 | 5.901 | 0.18% | 0.021µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [160.188µs; 160.270µs] or [-0.026%; +0.026%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 236.686ns | 249.830ns ± 15.754ns | 242.713ns ± 4.107ns | 251.950ns | 283.111ns | 291.809ns | 297.106ns | 22.41% | 1.376 | 0.476 | 6.29% | 1.114ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [247.646ns; 252.013ns] or [-0.874%; +0.874%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 49.062ms | 49.379ms ± 1.402ms | 49.215ms ± 0.039ms | 49.244ms | 49.308ms | 58.523ms | 62.322ms | 26.63% | 8.161 | 65.946 | 2.83% | 0.099ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [49.185ms; 49.573ms] or [-0.393%; +0.393%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.301µs | 146.489µs ± 1.648µs | 146.222µs ± 0.546µs | 146.847µs | 148.550µs | 152.226µs | 161.849µs | 10.69% | 5.140 | 39.874 | 1.12% | 0.117µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.261µs; 146.717µs] or [-0.156%; +0.156%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.397ms | 3.428ms ± 0.024ms | 3.421ms ± 0.009ms | 3.434ms | 3.483ms | 3.506ms | 3.514ms | 2.73% | 1.577 | 2.024 | 0.70% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.425ms; 3.432ms] or [-0.097%; +0.097%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 717.238µs | 717.963µs ± 0.396µs | 717.892µs ± 0.270µs | 718.181µs | 718.715µs | 719.016µs | 719.545µs | 0.23% | 0.851 | 0.744 | 0.06% | 0.028µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [717.908µs; 718.018µs] or [-0.008%; +0.008%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 12.928ms | 12.963ms ± 0.017ms | 12.961ms ± 0.009ms | 12.970ms | 12.992ms | 13.021ms | 13.039ms | 0.60% | 1.342 | 3.349 | 0.13% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [12.961ms; 12.965ms] or [-0.018%; +0.018%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 18.239µs | 26.410µs ± 9.245µs | 19.304µs ± 0.912µs | 34.764µs | 43.364µs | 44.139µs | 64.769µs | 235.53% | 0.833 | 0.019 | 34.92% | 0.654µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [25.129µs; 27.691µs] or [-4.852%; +4.852%] | None | None | None |
Group 20
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | b22126b | 1773778880 | gyuheon0h/alpine-libunwind-build-debug |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.931ns | 193.225ns ± 2.084ns | 193.005ns ± 1.700ns | 194.515ns | 197.224ns | 198.758ns | 200.796ns | 4.04% | 0.916 | 0.289 | 1.08% | 0.147ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.936ns; 193.514ns] or [-0.149%; +0.149%] | None | None | None |
Baseline
Omitted due to size.
Clippy Allow Annotation ReportComparing clippy allow annotations between branches:
Summary by Rule
Annotation Counts by File
Annotation Stats by Crate
About This ReportThis report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1753 +/- ##
=======================================
Coverage 71.48% 71.49%
=======================================
Files 430 430
Lines 64041 64041
=======================================
+ Hits 45782 45783 +1
+ Misses 18259 18258 -1
🚀 New features to boost your workflow:
|

What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.