|
1 | 1 | # Changelog |
2 | 2 |
|
3 | | - |
4 | 3 | <sub>The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).</sub> |
5 | 4 |
|
6 | | - |
7 | | - |
8 | 5 | ## [4.0.0] - 2025-07-10 |
9 | 6 |
|
10 | 7 | ### <!-- 0 -->🚀 Features |
| 8 | + |
11 | 9 | - Update readme by @art049 |
12 | 10 | - Support pytest-benchmark's pedantic API by @art049 in [#81](https://github.com/CodSpeedHQ/pytest-codspeed/pull/81) |
13 | 11 | - Make sure the benchmark fixture can only be called once per bench by @art049 |
|
40 | 38 | - Add support for returning values (#12) by @patrick91 in [#12](https://github.com/CodSpeedHQ/pytest-codspeed/pull/12) |
41 | 39 | - Warmup performance map generation by @art049 |
42 | 40 | - Add some details about the callgraph generation status in the header by @art049 |
43 | | -- Test that perf maps are generated by @art049 |
44 | | -- Add a local test matrix with hatch by @art049 |
45 | | -- Test that benchmark selection with -k works by @art049 |
46 | 41 | - Add support for CPython3.12 and perf trampoline by @art049 |
47 | 42 | - Add introspection benchmarks by @art049 in [#9](https://github.com/CodSpeedHQ/pytest-codspeed/pull/9) |
48 | 43 | - Add library metadata in the profile output by @art049 in [#5](https://github.com/CodSpeedHQ/pytest-codspeed/pull/5) |
49 | 44 | - Allow running along with pytest-benchmarks by @art049 |
50 | 45 |
|
51 | 46 | ### <!-- 1 -->🐛 Bug Fixes |
| 47 | + |
52 | 48 | - Reenable walltime instrument hooks by @art049 in [#82](https://github.com/CodSpeedHQ/pytest-codspeed/pull/82) |
53 | 49 | - Fix native library typing by @art049 |
54 | 50 | - Use time per iteration instead of total round time in stats by @art049 |
|
76 | 72 | - Match the test output in any order by @art049 |
77 | 73 |
|
78 | 74 | ### <!-- 2 -->🏗️ Refactor |
| 75 | + |
79 | 76 | - Replace hardcoded outlier factor for improved readability by @art049 in [#67](https://github.com/CodSpeedHQ/pytest-codspeed/pull/67) |
80 | 77 | - Remove the scripted semver generation by @art049 |
81 | 78 | - Differentiate the mode from the underlying instrument by @art049 |
|
86 | 83 | - Manage compatibility env in the conftest by @art049 |
87 | 84 |
|
88 | 85 | ### <!-- 3 -->📚 Documentation |
| 86 | + |
89 | 87 | - Update action version in the CI workflow configuration (#39) by @frgfm in [#39](https://github.com/CodSpeedHQ/pytest-codspeed/pull/39) |
90 | 88 | - Bump action versions in README by @adriencaccia |
91 | 89 |
|
92 | 90 | ### <!-- 6 -->🧪 Testing |
| 91 | + |
93 | 92 | - Add benches from the documentation's getting started by @art049 in [#71](https://github.com/CodSpeedHQ/pytest-codspeed/pull/71) |
94 | 93 | - Add simple python benches by @art049 |
95 | 94 | - Add benches for various syscalls by @art049 |
|
98 | 97 | - Add benches for TheAlgorithms/audio_filters by @art049 in [#42](https://github.com/CodSpeedHQ/pytest-codspeed/pull/42) |
99 | 98 |
|
100 | 99 | ### <!-- 7 -->⚙️ Internals |
101 | | -- Remove pre-releases from git-cliff changelog |
| 100 | + |
| 101 | +- Test that perf maps are generated by @art049 |
| 102 | +- Add a local test matrix with hatch by @art049 |
| 103 | +- Test that benchmark selection with -k works by @art049 |
| 104 | +- Remove pre-releases from git-cliff changelog by @art049 |
102 | 105 | - Link to the documentation by @art049 |
103 | 106 | - Improve reliability of perf trampoline compatibility checks by @art049 |
104 | 107 | - Bump ruff by @art049 |
|
151 | 154 | - Continue running on matrix item error by @art049 |
152 | 155 | - Add a CI configuration with pytest-benchmark installed by @art049 |
153 | 156 |
|
| 157 | +## [3.2.0] - 2025-01-31 |
| 158 | + |
| 159 | +### <!-- 0 -->🚀 Features |
| 160 | + |
| 161 | +- Increase the min round time to a bigger value (+/- 1ms) by @art049 |
| 162 | +- Add benchmarks-walltime job to run additional performance benchmarks by @art049 in [#65](https://github.com/CodSpeedHQ/pytest-codspeed/pull/65) |
| 163 | +- Fix the random seed while measuring with instruments by @art049 in [#48](https://github.com/CodSpeedHQ/pytest-codspeed/pull/48) |
| 164 | + |
| 165 | +### <!-- 1 -->🐛 Bug Fixes |
| 166 | + |
| 167 | +- Use time per iteration instead of total round time in stats by @art049 |
| 168 | + |
| 169 | +### <!-- 2 -->🏗️ Refactor |
| 170 | + |
| 171 | +- Replace hardcoded outlier factor for improved readability by @art049 in [#67](https://github.com/CodSpeedHQ/pytest-codspeed/pull/67) |
| 172 | + |
| 173 | +### <!-- 7 -->⚙️ Internals |
| 174 | + |
| 175 | +- Fix self-dependency by @adriencaccia in [#66](https://github.com/CodSpeedHQ/pytest-codspeed/pull/66) |
| 176 | +- Fix uv version in CI by @adriencaccia |
| 177 | + |
| 178 | +## [3.1.2] - 2025-01-09 |
| 179 | + |
| 180 | +### <!-- 1 -->🐛 Bug Fixes |
| 181 | + |
| 182 | +- Update package_data to include header and source files for valgrind wrapper by @art049 in [#64](https://github.com/CodSpeedHQ/pytest-codspeed/pull/64) |
| 183 | + |
| 184 | +## [3.1.1] - 2025-01-07 |
| 185 | + |
| 186 | +### <!-- 7 -->⚙️ Internals |
| 187 | + |
| 188 | +- Fix tag num with bumpver by @art049 in [#61](https://github.com/CodSpeedHQ/pytest-codspeed/pull/61) |
| 189 | +- Update uv lock before release by @art049 |
| 190 | +- Add a py3-none-any fallback wheel by @art049 |
| 191 | + |
| 192 | +## [3.1.0] - 2024-12-09 |
| 193 | + |
| 194 | +### <!-- 0 -->🚀 Features |
| 195 | + |
| 196 | +- Check buildability and fallback when build doesn't work by @art049 |
| 197 | +- Compile the callgrind wrapper at build time by @art049 |
| 198 | + |
| 199 | +### <!-- 1 -->🐛 Bug Fixes |
| 200 | + |
| 201 | +- Allow build on arm64 by @art049 |
| 202 | + |
| 203 | +### <!-- 2 -->🏗️ Refactor |
| 204 | + |
| 205 | +- Remove the scripted semver generation by @art049 |
| 206 | + |
| 207 | +### <!-- 7 -->⚙️ Internals |
| 208 | + |
| 209 | +- Build wheels with cibuildwheel by @art049 |
| 210 | +- Allow forcing integrated tests by @art049 |
| 211 | +- Fix release script by @art049 |
| 212 | +- Use bumpver to manage versions by @art049 |
| 213 | +- Add a changelog by @art049 |
| 214 | +- Force native extension build in CI by @art049 |
| 215 | +- Updated matrix release workflow by @art049 |
| 216 | +- Use a common python version in the codspeed job by @art049 |
| 217 | +- Fix the codspeed workflow by @art049 |
| 218 | +- Use uv in CI by @art049 |
| 219 | +- Commit uv lock file by @art049 |
| 220 | +- Fix typo in cibuildwheel config by @art049 in [#57](https://github.com/CodSpeedHQ/pytest-codspeed/pull/57) |
| 221 | + |
| 222 | +## [3.0.0] - 2024-10-29 |
| 223 | + |
| 224 | +### <!-- 0 -->🚀 Features |
| 225 | + |
| 226 | +- Send more outlier data by @art049 |
| 227 | +- Also save the lower and upper fences in the json data by @art049 in [#46](https://github.com/CodSpeedHQ/pytest-codspeed/pull/46) |
| 228 | +- Also save the q1 and q3 in the json data by @art049 in [#45](https://github.com/CodSpeedHQ/pytest-codspeed/pull/45) |
| 229 | +- Add the --codspeed-max-time flag by @art049 |
| 230 | +- Send the semver version to cospeed instead of the PEP440 one by @art049 in [#44](https://github.com/CodSpeedHQ/pytest-codspeed/pull/44) |
| 231 | +- Also store the semver version by @art049 |
| 232 | +- Improve table style when displaying results by @art049 in [#41](https://github.com/CodSpeedHQ/pytest-codspeed/pull/41) |
| 233 | +- Add the total bench time to the collected stats by @art049 |
| 234 | +- Add configuration and split tests between instruments by @art049 |
| 235 | +- Add outlier detection in the walltime instrument by @art049 |
| 236 | +- Implement the walltime instrument by @art049 |
| 237 | +- Add bench of various python noop by @art049 |
| 238 | +- Avoid overriding pytest's default protocol (#32) by @kenodegard in [#32](https://github.com/CodSpeedHQ/pytest-codspeed/pull/32) |
| 239 | + |
| 240 | +### <!-- 1 -->🐛 Bug Fixes |
| 241 | + |
| 242 | +- Fix compatibility with pytest-benchmark 5.0.0 by @art049 in [#54](https://github.com/CodSpeedHQ/pytest-codspeed/pull/54) |
| 243 | +- Fix display of parametrized tests by @art049 |
| 244 | +- Reenable gc logic by @art049 |
| 245 | +- Use importlib_metadata to keep backward compatibility by @art049 |
| 246 | +- Properly decide the mode depending on our env variable spec by @art049 |
| 247 | +- Disable pytest-speed when installed and codspeed is enabled by @art049 |
| 248 | + |
| 249 | +### <!-- 2 -->🏗️ Refactor |
| 250 | + |
| 251 | +- Differentiate the mode from the underlying instrument by @art049 |
| 252 | +- Move the instrumentation wrapper directly in the instrument by @art049 |
| 253 | +- Change Instrumentation to CPUInstrumentation by @art049 |
| 254 | +- Create an abstraction for each instrument by @art049 |
| 255 | + |
| 256 | +### <!-- 3 -->📚 Documentation |
| 257 | + |
| 258 | +- Update action version in the CI workflow configuration (#39) by @frgfm in [#39](https://github.com/CodSpeedHQ/pytest-codspeed/pull/39) |
| 259 | +- Bump action versions in README by @adriencaccia |
| 260 | + |
| 261 | +### <!-- 6 -->🧪 Testing |
| 262 | + |
| 263 | +- Add benches for various syscalls by @art049 |
| 264 | +- Refactor the algorithm benches using parametrization and add benches on bit_manipulation by @art049 |
| 265 | +- Add benches for TheAlgorithms/backtracking by @art049 in [#43](https://github.com/CodSpeedHQ/pytest-codspeed/pull/43) |
| 266 | +- Add benches for TheAlgorithms/audio_filters by @art049 in [#42](https://github.com/CodSpeedHQ/pytest-codspeed/pull/42) |
| 267 | + |
| 268 | +### <!-- 7 -->⚙️ Internals |
| 269 | + |
| 270 | +- Drop support for python3.8 by @art049 |
| 271 | +- Expose type information (#53) by @Dreamsorcerer in [#53](https://github.com/CodSpeedHQ/pytest-codspeed/pull/53) |
| 272 | +- Run the CI with ubuntu 24.04 by @art049 |
| 273 | +- Improve naming in workflow examples by @art049 |
| 274 | +- Bump actions/checkout to v4 (#47) by @fargito in [#47](https://github.com/CodSpeedHQ/pytest-codspeed/pull/47) |
| 275 | +- Add a test on the walltime instrument by @art049 |
| 276 | +- Fix utils test using a fake git repo by @art049 |
| 277 | +- Update readme by @art049 |
| 278 | +- Support python 3.13 and drop 3.7 by @art049 in [#40](https://github.com/CodSpeedHQ/pytest-codspeed/pull/40) |
| 279 | +- Add TCH, FA, and UP to ruff lints (#29) by @kenodegard in [#29](https://github.com/CodSpeedHQ/pytest-codspeed/pull/29) |
| 280 | + |
| 281 | +## [2.2.1] - 2024-03-19 |
| 282 | + |
| 283 | +### <!-- 0 -->🚀 Features |
| 284 | + |
| 285 | +- Support pytest 8.1.1 by @art049 |
| 286 | + |
| 287 | +### <!-- 1 -->🐛 Bug Fixes |
| 288 | + |
| 289 | +- Loosen runtime requirements (#21) by @edgarrmondragon in [#21](https://github.com/CodSpeedHQ/pytest-codspeed/pull/21) |
| 290 | + |
| 291 | +### <!-- 7 -->⚙️ Internals |
| 292 | + |
| 293 | +- Add all-checks job to CI workflow by @art049 in [#28](https://github.com/CodSpeedHQ/pytest-codspeed/pull/28) |
| 294 | +- Switch from black to ruff format by @art049 |
| 295 | +- Update action version in README.md by @adriencaccia |
| 296 | +- Add codspeed badge to the readme by @art049 |
| 297 | + |
| 298 | +## [2.2.0] - 2023-09-01 |
| 299 | + |
| 300 | +### <!-- 0 -->🚀 Features |
| 301 | + |
| 302 | +- Avoid concurrent wrapper builds by @art049 |
| 303 | +- Add a test for pytest-xdist compatibility by @art049 |
| 304 | + |
| 305 | +### <!-- 1 -->🐛 Bug Fixes |
| 306 | + |
| 307 | +- Fix xdist test output assertion by @art049 |
| 308 | + |
| 309 | +## [2.1.0] - 2023-07-27 |
| 310 | + |
| 311 | +### <!-- 1 -->🐛 Bug Fixes |
| 312 | + |
| 313 | +- Fix relative git path when using working-directory by @art049 in [#15](https://github.com/CodSpeedHQ/pytest-codspeed/pull/15) |
| 314 | +- Fix typo in release.yml (#14) by @art049 in [#14](https://github.com/CodSpeedHQ/pytest-codspeed/pull/14) |
| 315 | + |
| 316 | +## [2.0.1] - 2023-07-22 |
| 317 | + |
| 318 | +### <!-- 0 -->🚀 Features |
| 319 | + |
| 320 | +- Release the package from the CI with trusted provider by @art049 |
| 321 | +- Add a return type to the benchmark fixture by @art049 in [#13](https://github.com/CodSpeedHQ/pytest-codspeed/pull/13) |
| 322 | +- Add support for returning values (#12) by @patrick91 in [#12](https://github.com/CodSpeedHQ/pytest-codspeed/pull/12) |
| 323 | + |
| 324 | +### <!-- 1 -->🐛 Bug Fixes |
| 325 | + |
| 326 | +- Fix setuptools installation with python3.12 by @art049 |
| 327 | + |
| 328 | +## [2.0.0] - 2023-07-04 |
| 329 | + |
| 330 | +### <!-- 0 -->🚀 Features |
| 331 | + |
| 332 | +- Warmup performance map generation by @art049 |
| 333 | +- Add some details about the callgraph generation status in the header by @art049 |
| 334 | +- Test that perf maps are generated by @art049 |
| 335 | +- Add a local test matrix with hatch by @art049 |
| 336 | +- Test that benchmark selection with -k works by @art049 |
| 337 | +- Add support for CPython3.12 and perf trampoline by @art049 |
| 338 | +- Add introspection benchmarks by @art049 in [#9](https://github.com/CodSpeedHQ/pytest-codspeed/pull/9) |
| 339 | + |
| 340 | +### <!-- 1 -->🐛 Bug Fixes |
| 341 | + |
| 342 | +- Support benchmark.extra_info parameters on the fixture by @art049 in [#10](https://github.com/CodSpeedHQ/pytest-codspeed/pull/10) |
| 343 | +- Filter out pytest-benchmark warnings in the tests by @art049 |
| 344 | + |
| 345 | +### <!-- 2 -->🏗️ Refactor |
| 346 | + |
| 347 | +- Use the pytest_run_protocol hook for better exec control by @art049 |
| 348 | + |
| 349 | +### <!-- 7 -->⚙️ Internals |
| 350 | + |
| 351 | +- Separate the benchmark workflow by @art049 in [#8](https://github.com/CodSpeedHQ/pytest-codspeed/pull/8) |
| 352 | +- Bump version to 1.3.0 to trigger the callgraph generation by @art049 |
| 353 | +- Reuse same test code in the tests by @art049 |
| 354 | +- Bump linting dependencies by @art049 |
| 355 | +- Bump precommit in the CI by @art049 |
| 356 | +- Add python3.12 to the ci matrix by @art049 |
| 357 | +- Restructure dev dependencies by @art049 |
| 358 | +- Replace isort by ruff by @art049 in [#11](https://github.com/CodSpeedHQ/pytest-codspeed/pull/11) |
| 359 | +- Add discord badge in the readme by @art049 |
| 360 | + |
| 361 | +## [1.2.2] - 2022-12-02 |
| 362 | + |
| 363 | +### <!-- 0 -->🚀 Features |
| 364 | + |
| 365 | +- Add library metadata in the profile output by @art049 in [#5](https://github.com/CodSpeedHQ/pytest-codspeed/pull/5) |
| 366 | + |
| 367 | +## [1.2.1] - 2022-11-28 |
| 368 | + |
| 369 | +### <!-- 1 -->🐛 Bug Fixes |
| 370 | + |
| 371 | +- Support kwargs with the benchmark fixture by @art049 in [#4](https://github.com/CodSpeedHQ/pytest-codspeed/pull/4) |
| 372 | + |
| 373 | +## [1.2.0] - 2022-11-22 |
| 374 | + |
| 375 | +### <!-- 1 -->🐛 Bug Fixes |
| 376 | + |
| 377 | +- Avoid wrapping the callable to maintain existing results by @art049 |
| 378 | +- Disable automatic garbage collection to increase stability by @art049 in [#2](https://github.com/CodSpeedHQ/pytest-codspeed/pull/2) |
| 379 | +- Update readme by @art049 |
| 380 | + |
| 381 | +### <!-- 7 -->⚙️ Internals |
| 382 | + |
| 383 | +- Update readme by @art049 |
| 384 | + |
| 385 | +## [1.1.0] - 2022-11-10 |
| 386 | + |
| 387 | +### <!-- 0 -->🚀 Features |
| 388 | + |
| 389 | +- Allow running along with pytest-benchmarks by @art049 |
| 390 | + |
| 391 | +### <!-- 1 -->🐛 Bug Fixes |
| 392 | + |
| 393 | +- Fix the release script by @art049 |
| 394 | +- Make the release script executable by @art049 |
| 395 | +- Match the test output in any order by @art049 |
| 396 | + |
| 397 | +### <!-- 2 -->🏗️ Refactor |
| 398 | + |
| 399 | +- Manage compatibility env in the conftest by @art049 |
| 400 | + |
| 401 | +### <!-- 7 -->⚙️ Internals |
| 402 | + |
| 403 | +- Add a pytest-benchmark compatibility test by @art049 in [#1](https://github.com/CodSpeedHQ/pytest-codspeed/pull/1) |
| 404 | +- Add more details on the pytest run by @art049 |
| 405 | +- Continue running on matrix item error by @art049 |
| 406 | +- Add a CI configuration with pytest-benchmark installed by @art049 |
154 | 407 |
|
| 408 | +[3.2.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.2..v3.2.0 |
| 409 | +[3.1.2]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.1..v3.1.2 |
| 410 | +[3.1.1]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.0..v3.1.1 |
| 411 | +[3.1.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.1.0-beta..v3.1.0 |
| 412 | +[3.1.0-beta]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0..v3.1.0-beta |
| 413 | +[3.0.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b4..v3.0.0 |
| 414 | +[3.0.0b4]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b3..v3.0.0b4 |
| 415 | +[3.0.0b3]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b2..v3.0.0b3 |
| 416 | +[3.0.0b2]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b1..v3.0.0b2 |
| 417 | +[3.0.0b1]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v3.0.0b0..v3.0.0b1 |
| 418 | +[3.0.0b0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v2.2.1..v3.0.0b0 |
| 419 | +[2.2.1]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v2.2.0..v2.2.1 |
| 420 | +[2.2.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v2.1.0..v2.2.0 |
| 421 | +[2.1.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v2.0.1..v2.1.0 |
| 422 | +[2.0.1]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v2.0.0..v2.0.1 |
| 423 | +[2.0.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v1.2.2..v2.0.0 |
| 424 | +[1.2.2]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v1.2.1..v1.2.2 |
| 425 | +[1.2.1]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v1.2.0..v1.2.1 |
| 426 | +[1.2.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v1.1.0..v1.2.0 |
| 427 | +[1.1.0]: https://github.com/CodSpeedHQ/pytest-codspeed/compare/v1.0.4..v1.1.0 |
155 | 428 |
|
156 | 429 | <!-- generated by git-cliff --> |
0 commit comments