Skip to content

chore(internal): make PeriodicThread.awake() non-blocking on stopped threads#17707

Draft
r1viollet wants to merge 1 commit intomainfrom
r1viollet/fix-periodic-thread-awake-after-stop
Draft

chore(internal): make PeriodicThread.awake() non-blocking on stopped threads#17707
r1viollet wants to merge 1 commit intomainfrom
r1viollet/fix-periodic-thread-awake-after-stop

Conversation

@r1viollet
Copy link
Copy Markdown
Contributor

Description

Sibling to #17632. The native PeriodicThread.awake() cleared _served and
then waited on it. When called after stop() had completed:

  1. The worker had already set _served one last time during cleanup
    (_threads.cpp:625) and exited.
  2. awake() cleared _served again.
  3. Nothing would set it again, so _served->wait() blocked forever.

The wait ran inside AllowThreads (GIL released), so not even a Python
signal.alarm handler could break out — SIGTERM was ignored and only
SIGKILL would reap the process.

This was surfaced by the periodic-thread lifecycle stress harness (#17633).

Fix

  • stop() now acquires _awake_mutex around the _stopping = true +
    _request->set(STOP) sequence, so it serializes with awake().
  • awake() re-checks _stopping under the mutex. If _stopping && !_skip_shutdown
    the worker is permanently stopped (not fork-paused) — raise RuntimeError
    instead of clearing _served and waiting forever.
  • The _before_fork()_after_fork() window (which flips _skip_shutdown)
    still works: _after_fork() spins up a new worker that consumes the queued
    AWAKE request and sets _served, so queued awake() calls during fork
    resume normally. Covered by the existing
    test_periodic_thread_preserves_awake_during_restart_window (passes here).

Testing

New regression test test_periodic_awake_after_stop_raises_not_hangs in
tests/internal/test_periodic.py. All 15 existing tests in that file still
pass:

============================== 15 passed in 4.24s ==============================

Standalone verification on a Linux workspace (Python 3.10) — before the fix
the reproducer had to be killed with SIGKILL; after:

OK: awake raised: Periodic thread is stopped

Risks

Low. The only behavior change is: awake() on a thread that has completed
stop()+join() now raises RuntimeError instead of blocking forever. No
legitimate caller should be relying on the infinite-wait behavior — it was
always a hang.

Internal API; changelog/no-changelog.

Background

Found by the randomized lifecycle stress harness in #17633 while running a
larger-budget soak. The harness occasionally interleaves stopawake
and hit the hang; py-spy showed the main thread idle at _served->wait()
in awake().

🤖 Generated with Claude Code

@r1viollet r1viollet requested a review from a team as a code owner April 23, 2026 15:30
@r1viollet r1viollet added the changelog/no-changelog A changelog entry is not required for this PR. label Apr 23, 2026
@r1viollet r1viollet requested a review from brettlangdon April 23, 2026 15:31
@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Codeowners resolved as

ddtrace/internal/_threads.cpp                                           @DataDog/apm-core-python
tests/internal/test_periodic.py                                         @DataDog/apm-core-python

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 4586038113

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread ddtrace/internal/_threads.cpp
@r1viollet r1viollet marked this pull request as draft April 23, 2026 15:38
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Apr 23, 2026

Performance SLOs

Comparing candidate r1viollet/fix-periodic-thread-awake-after-stop (dd5488f) with baseline main (56e77c7)

📈 Performance Regressions (2 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 103.685µs (SLO: <130.000µs 📉 -20.2%) vs baseline: +4.0%

Memory: ✅ 43.922MB (SLO: <46.000MB -4.5%) vs baseline: +4.8%


✅ add_inplace_aspect

Time: ✅ 101.341µs (SLO: <130.000µs 📉 -22.0%) vs baseline: +0.5%

Memory: ✅ 44.344MB (SLO: <46.000MB -3.6%) vs baseline: +5.7%


✅ add_inplace_noaspect

Time: ✅ 28.400µs (SLO: <40.000µs 📉 -29.0%) vs baseline: +0.8%

Memory: ✅ 44.290MB (SLO: <46.000MB -3.7%) vs baseline: +5.6%


✅ add_noaspect

Time: ✅ 48.740µs (SLO: <70.000µs 📉 -30.4%) vs baseline: +0.4%

Memory: ✅ 44.049MB (SLO: <46.000MB -4.2%) vs baseline: +5.3%


✅ bytearray_aspect

Time: ✅ 269.328µs (SLO: <400.000µs 📉 -32.7%) vs baseline: +0.5%

Memory: ✅ 43.852MB (SLO: <46.000MB -4.7%) vs baseline: +5.0%


✅ bytearray_extend_aspect

Time: ✅ 659.222µs (SLO: <800.000µs 📉 -17.6%) vs baseline: +0.9%

Memory: ✅ 44.374MB (SLO: <46.000MB -3.5%) vs baseline: +6.2%


✅ bytearray_extend_noaspect

Time: ✅ 271.325µs (SLO: <400.000µs 📉 -32.2%) vs baseline: +1.0%

Memory: ✅ 43.944MB (SLO: <46.000MB -4.5%) vs baseline: +5.0%


✅ bytearray_noaspect

Time: ✅ 145.957µs (SLO: <300.000µs 📉 -51.3%) vs baseline: +0.3%

Memory: ✅ 44.284MB (SLO: <46.000MB -3.7%) vs baseline: +5.7%


✅ bytes_aspect

Time: ✅ 228.214µs (SLO: <300.000µs 📉 -23.9%) vs baseline: ~same

Memory: ✅ 43.958MB (SLO: <46.000MB -4.4%) vs baseline: +4.9%


✅ bytes_noaspect

Time: ✅ 137.807µs (SLO: <200.000µs 📉 -31.1%) vs baseline: -1.3%

Memory: ✅ 43.968MB (SLO: <46.000MB -4.4%) vs baseline: +5.2%


✅ bytesio_aspect

Time: ✅ 3.825ms (SLO: <5.000ms 📉 -23.5%) vs baseline: -0.1%

Memory: ✅ 43.938MB (SLO: <46.000MB -4.5%) vs baseline: +4.8%


✅ bytesio_noaspect

Time: ✅ 319.559µs (SLO: <420.000µs 📉 -23.9%) vs baseline: -0.2%

Memory: ✅ 44.013MB (SLO: <46.000MB -4.3%) vs baseline: +5.3%


✅ capitalize_aspect

Time: ✅ 89.278µs (SLO: <300.000µs 📉 -70.2%) vs baseline: -0.3%

Memory: ✅ 43.918MB (SLO: <46.000MB -4.5%) vs baseline: +5.0%


✅ capitalize_noaspect

Time: ✅ 275.115µs (SLO: <300.000µs -8.3%) vs baseline: 📈 +10.2%

Memory: ✅ 44.245MB (SLO: <46.000MB -3.8%) vs baseline: +5.9%


✅ casefold_aspect

Time: ✅ 88.909µs (SLO: <500.000µs 📉 -82.2%) vs baseline: ~same

Memory: ✅ 43.911MB (SLO: <46.000MB -4.5%) vs baseline: +4.7%


✅ casefold_noaspect

Time: ✅ 309.842µs (SLO: <500.000µs 📉 -38.0%) vs baseline: +1.6%

Memory: ✅ 43.910MB (SLO: <46.000MB -4.5%) vs baseline: +4.9%


✅ decode_aspect

Time: ✅ 86.642µs (SLO: <100.000µs 📉 -13.4%) vs baseline: -0.5%

Memory: ✅ 43.957MB (SLO: <46.000MB -4.4%) vs baseline: +5.1%


✅ decode_noaspect

Time: ✅ 157.745µs (SLO: <210.000µs 📉 -24.9%) vs baseline: +1.5%

Memory: ✅ 43.818MB (SLO: <46.000MB -4.7%) vs baseline: +4.6%


✅ encode_aspect

Time: ✅ 84.338µs (SLO: <200.000µs 📉 -57.8%) vs baseline: -0.3%

Memory: ✅ 43.969MB (SLO: <46.000MB -4.4%) vs baseline: +5.0%


✅ encode_noaspect

Time: ✅ 145.280µs (SLO: <200.000µs 📉 -27.4%) vs baseline: +0.3%

Memory: ✅ 44.008MB (SLO: <46.000MB -4.3%) vs baseline: +5.2%


✅ format_aspect

Time: ✅ 14.601ms (SLO: <19.200ms 📉 -24.0%) vs baseline: -0.2%

Memory: ✅ 43.924MB (SLO: <46.000MB -4.5%) vs baseline: +5.0%


✅ format_map_aspect

Time: ✅ 16.376ms (SLO: <21.500ms 📉 -23.8%) vs baseline: ~same

Memory: ✅ 43.924MB (SLO: <46.000MB -4.5%) vs baseline: +4.6%


✅ format_map_noaspect

Time: ✅ 361.761µs (SLO: <500.000µs 📉 -27.6%) vs baseline: +1.5%

Memory: ✅ 44.192MB (SLO: <46.000MB -3.9%) vs baseline: +5.3%


✅ format_noaspect

Time: ✅ 311.367µs (SLO: <500.000µs 📉 -37.7%) vs baseline: -0.4%

Memory: ✅ 43.974MB (SLO: <46.000MB -4.4%) vs baseline: +5.1%


✅ index_aspect

Time: ✅ 128.462µs (SLO: <300.000µs 📉 -57.2%) vs baseline: +4.7%

Memory: ✅ 43.890MB (SLO: <46.000MB -4.6%) vs baseline: +4.8%


✅ index_noaspect

Time: ✅ 40.539µs (SLO: <300.000µs 📉 -86.5%) vs baseline: -0.6%

Memory: ✅ 43.939MB (SLO: <46.000MB -4.5%) vs baseline: +5.2%


✅ join_aspect

Time: ✅ 216.880µs (SLO: <300.000µs 📉 -27.7%) vs baseline: +1.1%

Memory: ✅ 43.940MB (SLO: <46.000MB -4.5%) vs baseline: +4.9%


✅ join_noaspect

Time: ✅ 141.052µs (SLO: <300.000µs 📉 -53.0%) vs baseline: -1.0%

Memory: ✅ 43.986MB (SLO: <46.000MB -4.4%) vs baseline: +5.1%


✅ ljust_aspect

Time: ✅ 585.050µs (SLO: <700.000µs 📉 -16.4%) vs baseline: 📈 +16.6%

Memory: ✅ 43.856MB (SLO: <46.000MB -4.7%) vs baseline: +4.8%


✅ ljust_noaspect

Time: ✅ 262.086µs (SLO: <300.000µs 📉 -12.6%) vs baseline: +0.7%

Memory: ✅ 43.934MB (SLO: <46.000MB -4.5%) vs baseline: +5.0%


✅ lower_aspect

Time: ✅ 306.346µs (SLO: <500.000µs 📉 -38.7%) vs baseline: -1.2%

Memory: ✅ 43.877MB (SLO: <46.000MB -4.6%) vs baseline: +4.7%


✅ lower_noaspect

Time: ✅ 241.532µs (SLO: <300.000µs 📉 -19.5%) vs baseline: +2.0%

Memory: ✅ 43.869MB (SLO: <46.000MB -4.6%) vs baseline: +4.9%


✅ lstrip_aspect

Time: ✅ 0.272ms (SLO: <3.000ms 📉 -90.9%) vs baseline: -1.0%

Memory: ✅ 43.943MB (SLO: <46.000MB -4.5%) vs baseline: +5.1%


✅ lstrip_noaspect

Time: ✅ 0.179ms (SLO: <3.000ms 📉 -94.0%) vs baseline: +1.0%

Memory: ✅ 43.858MB (SLO: <46.000MB -4.7%) vs baseline: +4.9%


✅ modulo_aspect

Time: ✅ 14.251ms (SLO: <18.750ms 📉 -24.0%) vs baseline: +0.2%

Memory: ✅ 43.843MB (SLO: <46.000MB -4.7%) vs baseline: +4.5%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.751ms (SLO: <19.350ms 📉 -23.8%) vs baseline: ~same

Memory: ✅ 43.835MB (SLO: <46.000MB -4.7%) vs baseline: +4.4%


✅ modulo_aspect_for_bytes

Time: ✅ 14.344ms (SLO: <18.900ms 📉 -24.1%) vs baseline: ~same

Memory: ✅ 44.032MB (SLO: <46.000MB -4.3%) vs baseline: +5.0%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.585ms (SLO: <19.150ms 📉 -23.8%) vs baseline: +0.3%

Memory: ✅ 43.930MB (SLO: <46.000MB -4.5%) vs baseline: +4.7%


✅ modulo_noaspect

Time: ✅ 0.361ms (SLO: <3.000ms 📉 -88.0%) vs baseline: -1.4%

Memory: ✅ 43.929MB (SLO: <46.000MB -4.5%) vs baseline: +4.9%


✅ replace_aspect

Time: ✅ 18.384ms (SLO: <24.000ms 📉 -23.4%) vs baseline: +0.5%

Memory: ✅ 43.951MB (SLO: <46.000MB -4.5%) vs baseline: +5.0%


✅ replace_noaspect

Time: ✅ 286.242µs (SLO: <400.000µs 📉 -28.4%) vs baseline: -0.2%

Memory: ✅ 43.949MB (SLO: <46.000MB -4.5%) vs baseline: +4.9%


✅ repr_aspect

Time: ✅ 324.868µs (SLO: <420.000µs 📉 -22.7%) vs baseline: +0.2%

Memory: ✅ 43.891MB (SLO: <46.000MB -4.6%) vs baseline: +4.9%


✅ repr_noaspect

Time: ✅ 46.863µs (SLO: <90.000µs 📉 -47.9%) vs baseline: ~same

Memory: ✅ 44.013MB (SLO: <46.000MB -4.3%) vs baseline: +5.1%


✅ rstrip_aspect

Time: ✅ 386.886µs (SLO: <500.000µs 📉 -22.6%) vs baseline: -0.1%

Memory: ✅ 43.918MB (SLO: <46.000MB -4.5%) vs baseline: +5.1%


✅ rstrip_noaspect

Time: ✅ 188.049µs (SLO: <300.000µs 📉 -37.3%) vs baseline: +1.7%

Memory: ✅ 43.963MB (SLO: <46.000MB -4.4%) vs baseline: +5.2%


✅ slice_aspect

Time: ✅ 181.497µs (SLO: <300.000µs 📉 -39.5%) vs baseline: +0.5%

Memory: ✅ 43.914MB (SLO: <46.000MB -4.5%) vs baseline: +5.0%


✅ slice_noaspect

Time: ✅ 53.777µs (SLO: <90.000µs 📉 -40.2%) vs baseline: -1.3%

Memory: ✅ 43.871MB (SLO: <46.000MB -4.6%) vs baseline: +4.9%


✅ stringio_aspect

Time: ✅ 4.576ms (SLO: <5.000ms -8.5%) vs baseline: 📈 +18.7%

Memory: ✅ 43.914MB (SLO: <46.000MB -4.5%) vs baseline: +5.2%


✅ stringio_noaspect

Time: ✅ 356.154µs (SLO: <500.000µs 📉 -28.8%) vs baseline: ~same

Memory: ✅ 43.808MB (SLO: <46.000MB -4.8%) vs baseline: +4.7%


✅ strip_aspect

Time: ✅ 274.264µs (SLO: <350.000µs 📉 -21.6%) vs baseline: +0.4%

Memory: ✅ 44.004MB (SLO: <46.000MB -4.3%) vs baseline: +5.2%


✅ strip_noaspect

Time: ✅ 177.784µs (SLO: <240.000µs 📉 -25.9%) vs baseline: +1.0%

Memory: ✅ 43.998MB (SLO: <46.000MB -4.4%) vs baseline: +5.2%


✅ swapcase_aspect

Time: ✅ 347.719µs (SLO: <500.000µs 📉 -30.5%) vs baseline: ~same

Memory: ✅ 43.815MB (SLO: <46.000MB -4.8%) vs baseline: +4.5%


✅ swapcase_noaspect

Time: ✅ 272.255µs (SLO: <400.000µs 📉 -31.9%) vs baseline: -1.0%

Memory: ✅ 43.971MB (SLO: <46.000MB -4.4%) vs baseline: +5.0%


✅ title_aspect

Time: ✅ 335.554µs (SLO: <500.000µs 📉 -32.9%) vs baseline: +1.9%

Memory: ✅ 44.029MB (SLO: <46.000MB -4.3%) vs baseline: +5.3%


✅ title_noaspect

Time: ✅ 261.704µs (SLO: <400.000µs 📉 -34.6%) vs baseline: -1.6%

Memory: ✅ 43.945MB (SLO: <46.000MB -4.5%) vs baseline: +4.8%


✅ translate_aspect

Time: ✅ 514.148µs (SLO: <700.000µs 📉 -26.6%) vs baseline: +0.3%

Memory: ✅ 43.957MB (SLO: <46.000MB -4.4%) vs baseline: +5.1%


✅ translate_noaspect

Time: ✅ 424.591µs (SLO: <500.000µs 📉 -15.1%) vs baseline: -1.3%

Memory: ✅ 44.274MB (SLO: <46.000MB -3.8%) vs baseline: +5.6%


✅ upper_aspect

Time: ✅ 310.005µs (SLO: <500.000µs 📉 -38.0%) vs baseline: +1.4%

Memory: ✅ 43.855MB (SLO: <46.000MB -4.7%) vs baseline: +4.4%


✅ upper_noaspect

Time: ✅ 237.798µs (SLO: <400.000µs 📉 -40.6%) vs baseline: ~same

Memory: ✅ 43.985MB (SLO: <46.000MB -4.4%) vs baseline: +5.0%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 533.829µs (SLO: <700.000µs 📉 -23.7%) vs baseline: 📈 +27.7%

Memory: ✅ 43.936MB (SLO: <46.000MB -4.5%) vs baseline: +4.8%


✅ ospathbasename_noaspect

Time: ✅ 426.542µs (SLO: <700.000µs 📉 -39.1%) vs baseline: ~same

Memory: ✅ 43.752MB (SLO: <46.000MB -4.9%) vs baseline: +4.6%


✅ ospathjoin_aspect

Time: ✅ 627.135µs (SLO: <700.000µs 📉 -10.4%) vs baseline: ~same

Memory: ✅ 43.972MB (SLO: <46.000MB -4.4%) vs baseline: +5.2%


✅ ospathjoin_noaspect

Time: ✅ 637.514µs (SLO: <700.000µs -8.9%) vs baseline: ~same

Memory: ✅ 43.888MB (SLO: <46.000MB -4.6%) vs baseline: +4.9%


✅ ospathnormcase_aspect

Time: ✅ 350.894µs (SLO: <700.000µs 📉 -49.9%) vs baseline: +0.2%

Memory: ✅ 43.874MB (SLO: <46.000MB -4.6%) vs baseline: +4.8%


✅ ospathnormcase_noaspect

Time: ✅ 359.480µs (SLO: <700.000µs 📉 -48.6%) vs baseline: -0.2%

Memory: ✅ 43.841MB (SLO: <46.000MB -4.7%) vs baseline: +4.6%


✅ ospathsplit_aspect

Time: ✅ 485.689µs (SLO: <700.000µs 📉 -30.6%) vs baseline: +0.2%

Memory: ✅ 43.830MB (SLO: <46.000MB -4.7%) vs baseline: +4.7%


✅ ospathsplit_noaspect

Time: ✅ 492.659µs (SLO: <700.000µs 📉 -29.6%) vs baseline: +0.3%

Memory: ✅ 43.846MB (SLO: <46.000MB -4.7%) vs baseline: +4.6%


✅ ospathsplitdrive_aspect

Time: ✅ 368.830µs (SLO: <700.000µs 📉 -47.3%) vs baseline: -0.4%

Memory: ✅ 43.894MB (SLO: <46.000MB -4.6%) vs baseline: +4.9%


✅ ospathsplitdrive_noaspect

Time: ✅ 72.803µs (SLO: <700.000µs 📉 -89.6%) vs baseline: -0.4%

Memory: ✅ 43.891MB (SLO: <46.000MB -4.6%) vs baseline: +4.8%


✅ ospathsplitext_aspect

Time: ✅ 458.600µs (SLO: <700.000µs 📉 -34.5%) vs baseline: -0.4%

Memory: ✅ 43.821MB (SLO: <46.000MB -4.7%) vs baseline: +4.7%


✅ ospathsplitext_noaspect

Time: ✅ 464.167µs (SLO: <700.000µs 📉 -33.7%) vs baseline: ~same

Memory: ✅ 43.859MB (SLO: <46.000MB -4.7%) vs baseline: +4.7%

🟡 Near SLO Breach (7 suites)
🟡 djangosimple - 28/28

✅ appsec

Time: ✅ 19.558ms (SLO: <22.300ms 📉 -12.3%) vs baseline: ~same

Memory: ✅ 71.457MB (SLO: <73.500MB -2.8%) vs baseline: +4.8%


✅ exception-replay-enabled

Time: ✅ 1.365ms (SLO: <1.450ms -5.9%) vs baseline: +0.1%

Memory: ✅ 69.658MB (SLO: <71.500MB -2.6%) vs baseline: +4.6%


✅ iast

Time: ✅ 19.589ms (SLO: <22.250ms 📉 -12.0%) vs baseline: ~same

Memory: ✅ 71.339MB (SLO: <75.000MB -4.9%) vs baseline: +4.6%


✅ profiler

Time: ✅ 15.185ms (SLO: <16.550ms -8.2%) vs baseline: -0.5%

Memory: ✅ 60.522MB (SLO: <61.000MB 🟡 -0.8%) vs baseline: +4.8%


✅ resource-renaming

Time: ✅ 19.522ms (SLO: <21.750ms 📉 -10.2%) vs baseline: ~same

Memory: ✅ 71.689MB (SLO: <73.500MB -2.5%) vs baseline: +4.9%


✅ span-code-origin

Time: ✅ 20.038ms (SLO: <28.200ms 📉 -28.9%) vs baseline: +0.6%

Memory: ✅ 71.787MB (SLO: <75.000MB -4.3%) vs baseline: +4.8%


✅ tracer

Time: ✅ 19.571ms (SLO: <21.750ms 📉 -10.0%) vs baseline: +0.2%

Memory: ✅ 71.759MB (SLO: <75.000MB -4.3%) vs baseline: +5.2%


✅ tracer-and-profiler

Time: ✅ 20.997ms (SLO: <23.500ms 📉 -10.7%) vs baseline: +0.1%

Memory: ✅ 73.646MB (SLO: <75.000MB 🟡 -1.8%) vs baseline: +5.1%


✅ tracer-dont-create-db-spans

Time: ✅ 19.780ms (SLO: <21.500ms -8.0%) vs baseline: +0.5%

Memory: ✅ 71.468MB (SLO: <75.000MB -4.7%) vs baseline: +5.0%


✅ tracer-minimal

Time: ✅ 17.976ms (SLO: <18.500ms -2.8%) vs baseline: +0.4%

Memory: ✅ 71.555MB (SLO: <75.000MB -4.6%) vs baseline: +5.0%


✅ tracer-no-caches

Time: ✅ 18.787ms (SLO: <19.650ms -4.4%) vs baseline: -0.3%

Memory: ✅ 71.498MB (SLO: <75.000MB -4.7%) vs baseline: +4.7%


✅ tracer-no-databases

Time: ✅ 20.639ms (SLO: <21.100ms -2.2%) vs baseline: +0.1%

Memory: ✅ 71.477MB (SLO: <75.000MB -4.7%) vs baseline: +4.7%


✅ tracer-no-middleware

Time: ✅ 20.777ms (SLO: <21.500ms -3.4%) vs baseline: ~same

Memory: ✅ 71.527MB (SLO: <75.000MB -4.6%) vs baseline: +4.9%


✅ tracer-no-templates

Time: ✅ 19.662ms (SLO: <22.000ms 📉 -10.6%) vs baseline: +1.4%

Memory: ✅ 71.458MB (SLO: <73.500MB -2.8%) vs baseline: +4.7%


🟡 iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.668µs (SLO: <60.000µs 📉 -18.9%) vs baseline: -0.2%

Memory: ✅ 41.111MB (SLO: <42.000MB -2.1%) vs baseline: +4.6%


✅ propagation_enabled

Time: ✅ 138.150µs (SLO: <190.000µs 📉 -27.3%) vs baseline: +1.2%

Memory: ✅ 41.229MB (SLO: <42.000MB 🟡 -1.8%) vs baseline: +5.5%


✅ propagation_enabled_100

Time: ✅ 1.583ms (SLO: <2.300ms 📉 -31.2%) vs baseline: ~same

Memory: ✅ 41.150MB (SLO: <42.000MB -2.0%) vs baseline: +4.8%


✅ propagation_enabled_1000

Time: ✅ 29.355ms (SLO: <34.550ms 📉 -15.0%) vs baseline: +0.3%

Memory: ✅ 41.209MB (SLO: <42.000MB 🟡 -1.9%) vs baseline: +5.2%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 41.688ms (SLO: <47.150ms 📉 -11.6%) vs baseline: +0.6%

Memory: ✅ 41.675MB (SLO: <47.000MB 📉 -11.3%) vs baseline: +4.7%


✅ add-metrics

Time: ✅ 233.990ms (SLO: <344.800ms 📉 -32.1%) vs baseline: -0.8%

Memory: ✅ 45.376MB (SLO: <47.500MB -4.5%) vs baseline: +4.3%


✅ add-tags

Time: ✅ 262.437ms (SLO: <330.000ms 📉 -20.5%) vs baseline: -0.7%

Memory: ✅ 45.487MB (SLO: <47.500MB -4.2%) vs baseline: +4.7%


✅ get-context

Time: ✅ 81.136ms (SLO: <92.350ms 📉 -12.1%) vs baseline: +0.5%

Memory: ✅ 41.209MB (SLO: <46.500MB 📉 -11.4%) vs baseline: +5.0%


✅ is-recording

Time: ✅ 37.925ms (SLO: <44.500ms 📉 -14.8%) vs baseline: ~same

Memory: ✅ 41.036MB (SLO: <47.500MB 📉 -13.6%) vs baseline: +4.6%


✅ record-exception

Time: ✅ 62.894ms (SLO: <67.650ms -7.0%) vs baseline: +0.2%

Memory: ✅ 41.684MB (SLO: <47.000MB 📉 -11.3%) vs baseline: +4.9%


✅ set-status

Time: ✅ 43.751ms (SLO: <50.400ms 📉 -13.2%) vs baseline: +0.4%

Memory: ✅ 40.910MB (SLO: <47.000MB 📉 -13.0%) vs baseline: +4.6%


✅ start

Time: ✅ 38.941ms (SLO: <44.500ms 📉 -12.5%) vs baseline: +4.6%

Memory: ✅ 40.999MB (SLO: <47.000MB 📉 -12.8%) vs baseline: +5.0%


✅ start-finish

Time: ✅ 89.586ms (SLO: <92.000ms -2.6%) vs baseline: -0.5%

Memory: ✅ 38.810MB (SLO: <46.500MB 📉 -16.5%) vs baseline: +4.8%


✅ start-finish-telemetry

Time: ✅ 91.444ms (SLO: <93.000ms 🟡 -1.7%) vs baseline: -0.4%

Memory: ✅ 38.889MB (SLO: <46.500MB 📉 -16.4%) vs baseline: +4.9%


✅ update-name

Time: ✅ 39.091ms (SLO: <45.150ms 📉 -13.4%) vs baseline: -0.3%

Memory: ✅ 41.028MB (SLO: <47.000MB 📉 -12.7%) vs baseline: +4.8%


🟡 packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 168.846µs (SLO: <170.000µs 🟡 -0.7%) vs baseline: +0.9%

Memory: ✅ 41.260MB (SLO: <46.000MB 📉 -10.3%) vs baseline: +4.4%


✅ import_many_cached

Time: ✅ 131.637µs (SLO: <170.000µs 📉 -22.6%) vs baseline: -0.9%

Memory: ✅ 41.012MB (SLO: <46.000MB 📉 -10.8%) vs baseline: +4.3%


✅ import_many_stdlib

Time: ✅ 1.258ms (SLO: <1.750ms 📉 -28.1%) vs baseline: +0.8%

Memory: ✅ 41.172MB (SLO: <46.000MB 📉 -10.5%) vs baseline: +5.2%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.627ms (SLO: <1.100ms 📉 -43.0%) vs baseline: ~same

Memory: ✅ 41.068MB (SLO: <46.000MB 📉 -10.7%) vs baseline: +4.8%


✅ import_many_unknown

Time: ✅ 892.469µs (SLO: <960.000µs -7.0%) vs baseline: +0.3%

Memory: ✅ 41.415MB (SLO: <46.000MB -10.0%) vs baseline: +4.6%


✅ import_many_unknown_cached

Time: ✅ 847.435µs (SLO: <870.000µs -2.6%) vs baseline: -1.0%

Memory: ✅ 41.141MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +3.9%


✅ import_one

Time: ✅ 23.012µs (SLO: <30.000µs 📉 -23.3%) vs baseline: +0.7%

Memory: ✅ 41.145MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +5.3%


✅ import_one_cache

Time: ✅ 9.062µs (SLO: <10.000µs -9.4%) vs baseline: +1.5%

Memory: ✅ 40.893MB (SLO: <46.000MB 📉 -11.1%) vs baseline: +4.2%


✅ import_one_stdlib

Time: ✅ 21.773µs (SLO: <30.000µs 📉 -27.4%) vs baseline: -0.7%

Memory: ✅ 40.943MB (SLO: <46.000MB 📉 -11.0%) vs baseline: +4.4%


✅ import_one_stdlib_cache

Time: ✅ 8.946µs (SLO: <10.000µs 📉 -10.5%) vs baseline: -1.0%

Memory: ✅ 41.048MB (SLO: <46.000MB 📉 -10.8%) vs baseline: +4.8%


✅ import_one_unknown

Time: ✅ 50.024µs (SLO: <51.000µs 🟡 -1.9%) vs baseline: +0.2%

Memory: ✅ 41.131MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +4.5%


✅ import_one_unknown_cache

Time: ✅ 9.071µs (SLO: <10.000µs -9.3%) vs baseline: +0.8%

Memory: ✅ 41.160MB (SLO: <43.000MB -4.3%) vs baseline: +4.8%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 311.987ms (SLO: <320.950ms -2.8%) vs baseline: ~same

Memory: ✅ 37.454MB (SLO: <38.750MB -3.3%) vs baseline: +5.2%


✅ deep-profiled

Time: ✅ 329.073ms (SLO: <359.150ms -8.4%) vs baseline: ~same

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +4.5%


✅ medium

Time: ✅ 7.336ms (SLO: <7.450ms 🟡 -1.5%) vs baseline: -0.2%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.4%


✅ shallow

Time: ✅ 1.035ms (SLO: <1.050ms 🟡 -1.4%) vs baseline: +1.9%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +4.6%


🟡 span - 26/26

✅ add-event

Time: ✅ 20.422ms (SLO: <22.500ms -9.2%) vs baseline: ~same

Memory: ✅ 38.535MB (SLO: <53.000MB 📉 -27.3%) vs baseline: +4.8%


✅ add-metrics

Time: ✅ 90.771ms (SLO: <93.500ms -2.9%) vs baseline: ~same

Memory: ✅ 42.841MB (SLO: <53.000MB 📉 -19.2%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 136.077ms (SLO: <155.000ms 📉 -12.2%) vs baseline: -0.3%

Memory: ✅ 42.819MB (SLO: <53.000MB 📉 -19.2%) vs baseline: +5.3%


✅ get-context

Time: ✅ 17.871ms (SLO: <20.500ms 📉 -12.8%) vs baseline: -0.1%

Memory: ✅ 38.142MB (SLO: <53.000MB 📉 -28.0%) vs baseline: +5.2%


✅ is-recording

Time: ✅ 18.019ms (SLO: <20.500ms 📉 -12.1%) vs baseline: -0.3%

Memory: ✅ 38.103MB (SLO: <53.000MB 📉 -28.1%) vs baseline: +4.6%


✅ record-exception

Time: ✅ 41.922ms (SLO: <42.000ms 🟡 -0.2%) vs baseline: -0.1%

Memory: ✅ 38.928MB (SLO: <53.000MB 📉 -26.6%) vs baseline: +4.6%


✅ set-status

Time: ✅ 19.635ms (SLO: <22.000ms 📉 -10.7%) vs baseline: +0.1%

Memory: ✅ 38.063MB (SLO: <53.000MB 📉 -28.2%) vs baseline: +4.7%


✅ start

Time: ✅ 18.950ms (SLO: <20.500ms -7.6%) vs baseline: +6.1%

Memory: ✅ 38.181MB (SLO: <53.000MB 📉 -28.0%) vs baseline: +5.1%


✅ start-finish

Time: ✅ 57.957ms (SLO: <58.500ms 🟡 -0.9%) vs baseline: ~same

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.1%


✅ start-finish-telemetry

Time: ✅ 59.263ms (SLO: <60.000ms 🟡 -1.2%) vs baseline: +0.4%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +4.9%


✅ start-finish-traceid128

Time: ✅ 60.664ms (SLO: <62.000ms -2.2%) vs baseline: +0.4%

Memory: ✅ 36.176MB (SLO: <38.000MB -4.8%) vs baseline: +4.7%


✅ start-traceid128

Time: ✅ 18.007ms (SLO: <22.500ms 📉 -20.0%) vs baseline: +0.4%

Memory: ✅ 38.181MB (SLO: <53.000MB 📉 -28.0%) vs baseline: +4.9%


✅ update-name

Time: ✅ 18.559ms (SLO: <22.000ms 📉 -15.6%) vs baseline: -0.3%

Memory: ✅ 38.154MB (SLO: <53.000MB 📉 -28.0%) vs baseline: +4.9%


🟡 tracer - 6/6

✅ large

Time: ✅ 32.895ms (SLO: <33.950ms -3.1%) vs baseline: -0.6%

Memory: ✅ 37.316MB (SLO: <39.250MB -4.9%) vs baseline: +4.5%


✅ medium

Time: ✅ 3.185ms (SLO: <3.500ms -9.0%) vs baseline: -0.2%

Memory: ✅ 36.117MB (SLO: <38.750MB -6.8%) vs baseline: +4.6%


✅ small

Time: ✅ 388.136µs (SLO: <390.000µs 🟡 -0.5%) vs baseline: +4.2%

Memory: ✅ 36.156MB (SLO: <38.750MB -6.7%) vs baseline: +4.8%

⚠️ Unstable Tests (1 suite)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.625µs (SLO: <20.000µs 📉 -31.9%) vs baseline: -0.3%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.1%


✅ context_with_data_no_listeners

Time: ✅ 3.583µs (SLO: <10.000µs 📉 -64.2%) vs baseline: -0.6%

Memory: ✅ 36.097MB (SLO: <38.000MB -5.0%) vs baseline: +4.6%


✅ get_item_exists

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.2%


✅ get_item_missing

Time: ✅ 0.634µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.7%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +4.9%


✅ set_item

Time: ✅ 24.297µs (SLO: <30.000µs 📉 -19.0%) vs baseline: -0.2%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +4.9%

✅ All Tests Passing (16 suites)
codeprovenancefork - 2/2

✅ fork-10

Time: ✅ 2.201s (SLO: <2.400s -8.3%) vs baseline: +2.3%

Memory: ✅ 17.380MB (SLO: <20.000MB 📉 -13.1%) vs baseline: +5.0%


errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.297ms (SLO: <19.850ms 📉 -17.9%) vs baseline: +0.3%

Memory: ✅ 71.349MB (SLO: <75.000MB -4.9%) vs baseline: +4.7%


✅ errortracking-enabled-user

Time: ✅ 16.256ms (SLO: <19.400ms 📉 -16.2%) vs baseline: +0.5%

Memory: ✅ 71.349MB (SLO: <75.000MB -4.9%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 17.419ms (SLO: <19.450ms 📉 -10.4%) vs baseline: ~same

Memory: ✅ 71.369MB (SLO: <75.000MB -4.8%) vs baseline: +4.8%


errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.113ms (SLO: <2.300ms -8.1%) vs baseline: +0.2%

Memory: ✅ 58.275MB (SLO: <60.000MB -2.9%) vs baseline: +4.5%


✅ errortracking-enabled-user

Time: ✅ 2.122ms (SLO: <2.250ms -5.7%) vs baseline: ~same

Memory: ✅ 58.334MB (SLO: <60.000MB -2.8%) vs baseline: +5.0%


✅ tracer-enabled

Time: ✅ 2.110ms (SLO: <2.300ms -8.3%) vs baseline: ~same

Memory: ✅ 58.312MB (SLO: <60.000MB -2.8%) vs baseline: +4.8%


flasksimple - 16/16

✅ appsec-get

Time: ✅ 3.396ms (SLO: <4.750ms 📉 -28.5%) vs baseline: ~same

Memory: ✅ 58.674MB (SLO: <66.500MB 📉 -11.8%) vs baseline: +4.9%


✅ appsec-post

Time: ✅ 2.898ms (SLO: <6.750ms 📉 -57.1%) vs baseline: ~same

Memory: ✅ 58.613MB (SLO: <66.500MB 📉 -11.9%) vs baseline: +4.9%


✅ appsec-telemetry

Time: ✅ 3.384ms (SLO: <4.750ms 📉 -28.7%) vs baseline: ~same

Memory: ✅ 58.559MB (SLO: <66.500MB 📉 -11.9%) vs baseline: +4.6%


✅ debugger

Time: ✅ 1.880ms (SLO: <2.000ms -6.0%) vs baseline: ~same

Memory: ✅ 49.381MB (SLO: <51.500MB -4.1%) vs baseline: +4.9%


✅ iast-get

Time: ✅ 1.875ms (SLO: <2.000ms -6.2%) vs baseline: +0.4%

Memory: ✅ 46.058MB (SLO: <49.000MB -6.0%) vs baseline: +5.0%


✅ profiler

Time: ✅ 1.908ms (SLO: <2.100ms -9.1%) vs baseline: +0.1%

Memory: ✅ 51.977MB (SLO: <53.500MB -2.8%) vs baseline: +4.9%


✅ resource-renaming

Time: ✅ 3.383ms (SLO: <3.650ms -7.3%) vs baseline: +0.3%

Memory: ✅ 58.656MB (SLO: <60.000MB -2.2%) vs baseline: +5.0%


✅ tracer

Time: ✅ 3.380ms (SLO: <3.650ms -7.4%) vs baseline: ~same

Memory: ✅ 58.641MB (SLO: <60.000MB -2.3%) vs baseline: +4.9%


flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.111ms (SLO: <4.200ms 📉 -49.7%) vs baseline: -0.2%

Memory: ✅ 58.668MB (SLO: <66.000MB 📉 -11.1%) vs baseline: +4.9%


✅ iast-enabled

Time: ✅ 2.116ms (SLO: <2.800ms 📉 -24.4%) vs baseline: ~same

Memory: ✅ 58.629MB (SLO: <62.500MB -6.2%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 2.107ms (SLO: <2.250ms -6.4%) vs baseline: ~same

Memory: ✅ 58.668MB (SLO: <60.000MB -2.2%) vs baseline: +5.0%


forktime - 4/4

✅ baseline

Time: ✅ 1.943ms (SLO: <3.000ms 📉 -35.2%) vs baseline: +5.5%

Memory: ✅ 29.255MB (SLO: <33.000MB 📉 -11.3%) vs baseline: +4.9%


✅ configured

Time: ✅ 9.384ms (SLO: <17.000ms 📉 -44.8%) vs baseline: +0.4%

Memory: ✅ 58.653MB (SLO: <60.000MB -2.2%) vs baseline: +5.0%


httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.059µs (SLO: <100.000µs 📉 -18.9%) vs baseline: +5.1%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +4.6%


✅ b3_headers

Time: ✅ 12.946µs (SLO: <20.000µs 📉 -35.3%) vs baseline: +0.3%

Memory: ✅ 36.589MB (SLO: <38.000MB -3.7%) vs baseline: +4.5%


✅ b3_single_headers

Time: ✅ 11.985µs (SLO: <20.000µs 📉 -40.1%) vs baseline: +0.7%

Memory: ✅ 36.431MB (SLO: <38.000MB -4.1%) vs baseline: +4.0%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 60.321µs (SLO: <80.000µs 📉 -24.6%) vs baseline: +0.3%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 63.975µs (SLO: <80.000µs 📉 -20.0%) vs baseline: +0.1%

Memory: ✅ 36.726MB (SLO: <38.000MB -3.4%) vs baseline: +5.1%


✅ empty_headers

Time: ✅ 1.301µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.3%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +5.0%


✅ full_t_id_datadog_headers

Time: ✅ 21.790µs (SLO: <30.000µs 📉 -27.4%) vs baseline: +0.4%

Memory: ✅ 36.608MB (SLO: <38.000MB -3.7%) vs baseline: +4.6%


✅ invalid_priority_header

Time: ✅ 5.913µs (SLO: <10.000µs 📉 -40.9%) vs baseline: +0.2%

Memory: ✅ 36.589MB (SLO: <38.000MB -3.7%) vs baseline: +4.4%


✅ invalid_span_id_header

Time: ✅ 5.903µs (SLO: <10.000µs 📉 -41.0%) vs baseline: +0.5%

Memory: ✅ 36.569MB (SLO: <38.000MB -3.8%) vs baseline: +4.6%


✅ invalid_tags_header

Time: ✅ 5.918µs (SLO: <10.000µs 📉 -40.8%) vs baseline: ~same

Memory: ✅ 36.648MB (SLO: <38.000MB -3.6%) vs baseline: +4.5%


✅ invalid_trace_id_header

Time: ✅ 5.927µs (SLO: <10.000µs 📉 -40.7%) vs baseline: +0.3%

Memory: ✅ 36.451MB (SLO: <38.000MB -4.1%) vs baseline: +4.1%


✅ large_header_no_matches

Time: ✅ 27.103µs (SLO: <30.000µs -9.7%) vs baseline: -0.2%

Memory: ✅ 36.451MB (SLO: <38.000MB -4.1%) vs baseline: +4.0%


✅ large_valid_headers_all

Time: ✅ 28.002µs (SLO: <40.000µs 📉 -30.0%) vs baseline: -0.1%

Memory: ✅ 36.392MB (SLO: <38.000MB -4.2%) vs baseline: +4.2%


✅ medium_header_no_matches

Time: ✅ 9.240µs (SLO: <20.000µs 📉 -53.8%) vs baseline: +0.3%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +4.1%


✅ medium_valid_headers_all

Time: ✅ 10.663µs (SLO: <20.000µs 📉 -46.7%) vs baseline: +0.4%

Memory: ✅ 36.431MB (SLO: <38.000MB -4.1%) vs baseline: +3.7%


✅ none_propagation_style

Time: ✅ 1.385µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -1.3%

Memory: ✅ 36.589MB (SLO: <38.000MB -3.7%) vs baseline: +5.4%


✅ tracecontext_headers

Time: ✅ 32.804µs (SLO: <40.000µs 📉 -18.0%) vs baseline: -0.1%

Memory: ✅ 36.648MB (SLO: <38.000MB -3.6%) vs baseline: +4.8%


✅ valid_headers_all

Time: ✅ 5.868µs (SLO: <10.000µs 📉 -41.3%) vs baseline: -0.4%

Memory: ✅ 36.392MB (SLO: <38.000MB -4.2%) vs baseline: +4.7%


✅ valid_headers_basic

Time: ✅ 5.515µs (SLO: <10.000µs 📉 -44.8%) vs baseline: +0.6%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +5.2%


✅ wsgi_empty_headers

Time: ✅ 1.301µs (SLO: <10.000µs 📉 -87.0%) vs baseline: ~same

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +4.5%


✅ wsgi_invalid_priority_header

Time: ✅ 5.966µs (SLO: <10.000µs 📉 -40.3%) vs baseline: +0.7%

Memory: ✅ 36.431MB (SLO: <38.000MB -4.1%) vs baseline: +4.1%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.300µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.3%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +4.8%


✅ wsgi_invalid_tags_header

Time: ✅ 5.987µs (SLO: <10.000µs 📉 -40.1%) vs baseline: +0.6%

Memory: ✅ 36.707MB (SLO: <38.000MB -3.4%) vs baseline: +4.9%


✅ wsgi_invalid_trace_id_header

Time: ✅ 5.926µs (SLO: <10.000µs 📉 -40.7%) vs baseline: -0.2%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +5.1%


✅ wsgi_large_header_no_matches

Time: ✅ 28.085µs (SLO: <40.000µs 📉 -29.8%) vs baseline: ~same

Memory: ✅ 36.805MB (SLO: <38.000MB -3.1%) vs baseline: +5.1%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.193µs (SLO: <40.000µs 📉 -27.0%) vs baseline: -0.2%

Memory: ✅ 36.766MB (SLO: <38.000MB -3.2%) vs baseline: +5.1%


✅ wsgi_medium_header_no_matches

Time: ✅ 9.507µs (SLO: <20.000µs 📉 -52.5%) vs baseline: -0.3%

Memory: ✅ 36.766MB (SLO: <38.000MB -3.2%) vs baseline: +4.9%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.002µs (SLO: <20.000µs 📉 -45.0%) vs baseline: +1.4%

Memory: ✅ 36.687MB (SLO: <38.000MB -3.5%) vs baseline: +4.9%


✅ wsgi_valid_headers_all

Time: ✅ 5.984µs (SLO: <10.000µs 📉 -40.2%) vs baseline: +0.6%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +4.1%


✅ wsgi_valid_headers_basic

Time: ✅ 5.546µs (SLO: <10.000µs 📉 -44.5%) vs baseline: +1.0%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +4.1%


httppropagationinject - 16/16

✅ ids_only

Time: ✅ 20.912µs (SLO: <30.000µs 📉 -30.3%) vs baseline: +3.9%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +4.3%


✅ with_all

Time: ✅ 27.310µs (SLO: <40.000µs 📉 -31.7%) vs baseline: +0.4%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.5%


✅ with_dd_origin

Time: ✅ 24.166µs (SLO: <30.000µs 📉 -19.4%) vs baseline: +0.3%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +4.9%


✅ with_priority_and_origin

Time: ✅ 23.405µs (SLO: <40.000µs 📉 -41.5%) vs baseline: ~same

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.0%


✅ with_sampling_priority

Time: ✅ 20.266µs (SLO: <30.000µs 📉 -32.4%) vs baseline: +0.3%

Memory: ✅ 36.471MB (SLO: <38.000MB -4.0%) vs baseline: +5.3%


✅ with_tags

Time: ✅ 25.245µs (SLO: <40.000µs 📉 -36.9%) vs baseline: +0.5%

Memory: ✅ 36.412MB (SLO: <38.000MB -4.2%) vs baseline: +5.1%


✅ with_tags_invalid

Time: ✅ 26.692µs (SLO: <40.000µs 📉 -33.3%) vs baseline: +0.5%

Memory: ✅ 36.451MB (SLO: <38.000MB -4.1%) vs baseline: +5.1%


✅ with_tags_max_size

Time: ✅ 25.654µs (SLO: <40.000µs 📉 -35.9%) vs baseline: ~same

Memory: ✅ 36.510MB (SLO: <38.000MB -3.9%) vs baseline: +5.4%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 154.257µs (SLO: <250.000µs 📉 -38.3%) vs baseline: +1.6%

Memory: ✅ 43.893MB (SLO: <46.000MB -4.6%) vs baseline: +4.6%


✅ rsplit_noaspect

Time: ✅ 156.418µs (SLO: <250.000µs 📉 -37.4%) vs baseline: -1.0%

Memory: ✅ 43.918MB (SLO: <46.000MB -4.5%) vs baseline: +4.9%


✅ split_aspect

Time: ✅ 146.739µs (SLO: <250.000µs 📉 -41.3%) vs baseline: +0.2%

Memory: ✅ 43.960MB (SLO: <46.000MB -4.4%) vs baseline: +5.1%


✅ split_noaspect

Time: ✅ 151.148µs (SLO: <250.000µs 📉 -39.5%) vs baseline: +0.7%

Memory: ✅ 43.924MB (SLO: <46.000MB -4.5%) vs baseline: +5.1%


✅ splitlines_aspect

Time: ✅ 145.013µs (SLO: <250.000µs 📉 -42.0%) vs baseline: -0.4%

Memory: ✅ 43.856MB (SLO: <46.000MB -4.7%) vs baseline: +5.0%


✅ splitlines_noaspect

Time: ✅ 150.554µs (SLO: <250.000µs 📉 -39.8%) vs baseline: +0.2%

Memory: ✅ 43.925MB (SLO: <46.000MB -4.5%) vs baseline: +4.8%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.798ms (SLO: <42.000ms -2.9%) vs baseline: +0.4%

Memory: ✅ 39.125MB (SLO: <40.750MB -4.0%) vs baseline: +4.9%


✅ add-link

Time: ✅ 36.607ms (SLO: <38.550ms -5.0%) vs baseline: +1.1%

Memory: ✅ 38.909MB (SLO: <40.750MB -4.5%) vs baseline: +4.5%


✅ add-metrics

Time: ✅ 218.148ms (SLO: <232.000ms -6.0%) vs baseline: ~same

Memory: ✅ 38.968MB (SLO: <40.750MB -4.4%) vs baseline: +4.3%


✅ add-tags

Time: ✅ 213.418ms (SLO: <221.600ms -3.7%) vs baseline: +1.4%

Memory: ✅ 39.105MB (SLO: <40.750MB -4.0%) vs baseline: +4.8%


✅ get-context

Time: ✅ 29.277ms (SLO: <31.300ms -6.5%) vs baseline: +0.3%

Memory: ✅ 39.184MB (SLO: <40.750MB -3.8%) vs baseline: +5.4%


✅ is-recording

Time: ✅ 29.204ms (SLO: <31.000ms -5.8%) vs baseline: +0.2%

Memory: ✅ 39.184MB (SLO: <40.750MB -3.8%) vs baseline: +5.3%


✅ record-exception

Time: ✅ 63.415ms (SLO: <65.850ms -3.7%) vs baseline: +0.5%

Memory: ✅ 39.046MB (SLO: <40.750MB -4.2%) vs baseline: +4.4%


✅ set-status

Time: ✅ 32.131ms (SLO: <34.150ms -5.9%) vs baseline: +0.6%

Memory: ✅ 39.125MB (SLO: <40.750MB -4.0%) vs baseline: +5.0%


✅ start

Time: ✅ 29.395ms (SLO: <30.150ms -2.5%) vs baseline: +2.1%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +5.0%


✅ start-finish

Time: ✅ 34.097ms (SLO: <35.350ms -3.5%) vs baseline: ~same

Memory: ✅ 39.125MB (SLO: <40.750MB -4.0%) vs baseline: +4.7%


✅ start-finish-telemetry

Time: ✅ 34.008ms (SLO: <35.450ms -4.1%) vs baseline: +0.3%

Memory: ✅ 39.086MB (SLO: <40.750MB -4.1%) vs baseline: +4.5%


✅ update-name

Time: ✅ 31.001ms (SLO: <33.400ms -7.2%) vs baseline: -0.3%

Memory: ✅ 39.046MB (SLO: <40.750MB -4.2%) vs baseline: +4.6%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 345.015ms (SLO: <354.300ms -2.6%) vs baseline: +0.3%

Memory: ✅ 43.038MB (SLO: <46.000MB -6.4%) vs baseline: +4.6%


✅ cache_on

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.2%

Memory: ✅ 41.167MB (SLO: <46.000MB 📉 -10.5%) vs baseline: +4.9%


ratelimiter - 12/12

✅ defaults

Time: ✅ 2.362µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +1.2%

Memory: ✅ 36.746MB (SLO: <38.000MB -3.3%) vs baseline: +5.6%


✅ high_rate_limit

Time: ✅ 2.423µs (SLO: <10.000µs 📉 -75.8%) vs baseline: +0.3%

Memory: ✅ 36.510MB (SLO: <38.000MB -3.9%) vs baseline: +4.7%


✅ long_window

Time: ✅ 2.332µs (SLO: <10.000µs 📉 -76.7%) vs baseline: -1.6%

Memory: ✅ 36.510MB (SLO: <38.000MB -3.9%) vs baseline: +4.7%


✅ low_rate_limit

Time: ✅ 2.368µs (SLO: <10.000µs 📉 -76.3%) vs baseline: ~same

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +5.3%


✅ no_rate_limit

Time: ✅ 0.829µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +1.1%

Memory: ✅ 36.549MB (SLO: <38.000MB -3.8%) vs baseline: +4.7%


✅ short_window

Time: ✅ 2.490µs (SLO: <10.000µs 📉 -75.1%) vs baseline: -0.5%

Memory: ✅ 36.490MB (SLO: <38.000MB -4.0%) vs baseline: +4.6%


samplingrules - 8/8

✅ average_match

Time: ✅ 146.309µs (SLO: <200.000µs 📉 -26.8%) vs baseline: -0.4%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +4.8%


✅ high_match

Time: ✅ 165.894µs (SLO: <200.000µs 📉 -17.1%) vs baseline: -1.0%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +4.9%


✅ low_match

Time: ✅ 122.751µs (SLO: <130.000µs -5.6%) vs baseline: +0.3%

Memory: ✅ 619.319MB (SLO: <780.000MB 📉 -20.6%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.650ms (SLO: <4.000ms 📉 -33.7%) vs baseline: -0.5%

Memory: ✅ 73.565MB (SLO: <85.000MB 📉 -13.5%) vs baseline: +4.7%


sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.633µs (SLO: <20.000µs 📉 -46.8%) vs baseline: +0.1%

Memory: ✅ 37.473MB (SLO: <38.750MB -3.3%) vs baseline: +5.0%


✅ all-enabled

Time: ✅ 40.111µs (SLO: <50.000µs 📉 -19.8%) vs baseline: +1.4%

Memory: ✅ 37.375MB (SLO: <38.750MB -3.5%) vs baseline: +4.8%


✅ collectipvariant_exists

Time: ✅ 40.332µs (SLO: <50.000µs 📉 -19.3%) vs baseline: +0.8%

Memory: ✅ 37.513MB (SLO: <38.750MB -3.2%) vs baseline: +5.1%


✅ no-collectipvariant

Time: ✅ 39.318µs (SLO: <50.000µs 📉 -21.4%) vs baseline: -1.2%

Memory: ✅ 37.395MB (SLO: <38.750MB -3.5%) vs baseline: +4.7%


✅ no-useragentvariant

Time: ✅ 38.359µs (SLO: <50.000µs 📉 -23.3%) vs baseline: +0.2%

Memory: ✅ 37.513MB (SLO: <38.750MB -3.2%) vs baseline: +5.0%


✅ obfuscation-no-query

Time: ✅ 39.785µs (SLO: <50.000µs 📉 -20.4%) vs baseline: -0.4%

Memory: ✅ 37.454MB (SLO: <38.750MB -3.3%) vs baseline: +4.6%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.779µs (SLO: <90.000µs 📉 -15.8%) vs baseline: -0.1%

Memory: ✅ 37.532MB (SLO: <38.750MB -3.1%) vs baseline: +4.9%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.591µs (SLO: <90.000µs 📉 -14.9%) vs baseline: +0.3%

Memory: ✅ 37.493MB (SLO: <38.750MB -3.2%) vs baseline: +5.1%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.575µs (SLO: <170.000µs -9.1%) vs baseline: +0.1%

Memory: ✅ 37.454MB (SLO: <38.750MB -3.3%) vs baseline: +4.7%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 149.128µs (SLO: <160.000µs -6.8%) vs baseline: +0.2%

Memory: ✅ 37.493MB (SLO: <38.750MB -3.2%) vs baseline: +4.7%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.370µs (SLO: <170.000µs -8.6%) vs baseline: +0.2%

Memory: ✅ 37.513MB (SLO: <38.750MB -3.2%) vs baseline: +4.8%


✅ useragentvariant_exists_1

Time: ✅ 38.885µs (SLO: <50.000µs 📉 -22.2%) vs baseline: -0.2%

Memory: ✅ 37.493MB (SLO: <38.750MB -3.2%) vs baseline: +5.0%


✅ useragentvariant_exists_2

Time: ✅ 39.781µs (SLO: <50.000µs 📉 -20.4%) vs baseline: -0.8%

Memory: ✅ 37.591MB (SLO: <38.750MB -3.0%) vs baseline: +5.2%


✅ useragentvariant_exists_3

Time: ✅ 39.274µs (SLO: <50.000µs 📉 -21.5%) vs baseline: -0.4%

Memory: ✅ 37.473MB (SLO: <38.750MB -3.3%) vs baseline: +4.8%


✅ useragentvariant_not_exists_1

Time: ✅ 39.035µs (SLO: <50.000µs 📉 -21.9%) vs baseline: +0.4%

Memory: ✅ 37.375MB (SLO: <38.750MB -3.5%) vs baseline: +4.9%


✅ useragentvariant_not_exists_2

Time: ✅ 38.868µs (SLO: <50.000µs 📉 -22.3%) vs baseline: -0.1%

Memory: ✅ 37.454MB (SLO: <38.750MB -3.3%) vs baseline: +5.7%


telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.326µs (SLO: <20.000µs 📉 -88.4%) vs baseline: +8.7%

Memory: ✅ 36.510MB (SLO: <38.000MB -3.9%) vs baseline: +4.7%


✅ 1-count-metrics-100-times

Time: ✅ 156.838µs (SLO: <220.000µs 📉 -28.7%) vs baseline: +0.3%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +4.6%


✅ 1-distribution-metric-1-times

Time: ✅ 2.440µs (SLO: <20.000µs 📉 -87.8%) vs baseline: +0.4%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +4.9%


✅ 1-distribution-metrics-100-times

Time: ✅ 168.944µs (SLO: <230.000µs 📉 -26.5%) vs baseline: +0.2%

Memory: ✅ 36.608MB (SLO: <38.000MB -3.7%) vs baseline: +4.9%


✅ 1-gauge-metric-1-times

Time: ✅ 1.966µs (SLO: <20.000µs 📉 -90.2%) vs baseline: -0.5%

Memory: ✅ 36.628MB (SLO: <38.000MB -3.6%) vs baseline: +4.9%


✅ 1-gauge-metrics-100-times

Time: ✅ 137.670µs (SLO: <150.000µs -8.2%) vs baseline: ~same

Memory: ✅ 36.569MB (SLO: <38.000MB -3.8%) vs baseline: +5.0%


✅ 1-rate-metric-1-times

Time: ✅ 2.274µs (SLO: <20.000µs 📉 -88.6%) vs baseline: -0.2%

Memory: ✅ 36.707MB (SLO: <38.000MB -3.4%) vs baseline: +5.0%


✅ 1-rate-metrics-100-times

Time: ✅ 167.417µs (SLO: <250.000µs 📉 -33.0%) vs baseline: -0.9%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +4.9%


✅ 100-count-metrics-100-times

Time: ✅ 15.558ms (SLO: <22.000ms 📉 -29.3%) vs baseline: ~same

Memory: ✅ 36.117MB (SLO: <38.000MB -5.0%) vs baseline: +4.3%


✅ 100-distribution-metrics-100-times

Time: ✅ 1.764ms (SLO: <2.550ms 📉 -30.8%) vs baseline: -0.3%

Memory: ✅ 36.490MB (SLO: <38.000MB -4.0%) vs baseline: +4.9%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.395ms (SLO: <1.550ms -10.0%) vs baseline: -0.6%

Memory: ✅ 36.176MB (SLO: <38.000MB -4.8%) vs baseline: +4.9%


✅ 100-rate-metrics-100-times

Time: ✅ 1.731ms (SLO: <2.550ms 📉 -32.1%) vs baseline: +0.2%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.3%


✅ flush-1-metric

Time: ✅ 3.715µs (SLO: <20.000µs 📉 -81.4%) vs baseline: +1.5%

Memory: ✅ 36.608MB (SLO: <38.000MB -3.7%) vs baseline: +5.1%


✅ flush-100-metrics

Time: ✅ 174.790µs (SLO: <250.000µs 📉 -30.1%) vs baseline: +1.0%

Memory: ✅ 36.490MB (SLO: <38.000MB -4.0%) vs baseline: +4.5%


✅ flush-1000-metrics

Time: ✅ 2.182ms (SLO: <2.500ms 📉 -12.7%) vs baseline: ~same

Memory: ✅ 37.415MB (SLO: <38.750MB -3.4%) vs baseline: +5.1%


telemetrydependencies - 4/4

✅ first-50-deps-sca-off

Time: ✅ 2.221ms (SLO: <3.500ms 📉 -36.5%) vs baseline: +1.1%

Memory: ✅ 40.442MB (SLO: <46.000MB 📉 -12.1%) vs baseline: +4.6%


✅ first-50-deps-sca-on

Time: ✅ 2.260ms (SLO: <3.750ms 📉 -39.7%) vs baseline: +0.3%

Memory: ✅ 40.678MB (SLO: <46.000MB 📉 -11.6%) vs baseline: +5.1%

ℹ️ Scenarios Missing SLO Configuration (46 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • iast_aspects-re_expand_aspect
  • iast_aspects-re_expand_noaspect
  • iast_aspects-re_findall_aspect
  • iast_aspects-re_findall_noaspect
  • iast_aspects-re_finditer_aspect
  • iast_aspects-re_finditer_noaspect
  • iast_aspects-re_fullmatch_aspect
  • iast_aspects-re_fullmatch_noaspect
  • iast_aspects-re_group_aspect
  • iast_aspects-re_group_noaspect
  • iast_aspects-re_groups_aspect
  • iast_aspects-re_groups_noaspect
  • iast_aspects-re_match_aspect
  • iast_aspects-re_match_noaspect
  • iast_aspects-re_search_aspect
  • iast_aspects-re_search_noaspect
  • iast_aspects-re_sub_aspect
  • iast_aspects-re_sub_noaspect
  • iast_aspects-re_subn_aspect
  • iast_aspects-re_subn_noaspect
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

…threads

Two failure modes are fixed:

1. Hang on awake() after a completed stop()/join(). The previous
   handshake used a one-shot `_served` Event: the worker set it once on
   exit and then went away. If awake() ran afterwards it cleared
   `_served`, signalled the request, and waited for an `_served->set()`
   that would never come. Because the wait ran with the GIL released,
   not even a Python-level signal handler could interrupt it; only
   SIGKILL recovered the process.

2. Deadlock between an in-flight awake() and a periodic callback that
   calls stop() on its own thread (the Timer._periodic pattern in
   ddtrace/internal/periodic.py). An earlier fix attempt had stop()
   acquire `_awake_mutex`, but awake() held that same mutex while
   waiting on `_served`: the worker-thread stop() then blocked on the
   mutex before the callback could return and the worker could signal
   completion — both threads waited forever.

Replace the `_served` Event handshake with a `std::condition_variable`
(`_awake_cond`) plus `_awake_waiting` / `_awake_served` flags. awake()
now waits via `cv::wait`, which releases `_awake_mutex` while blocked,
so stop() can synchronize with request publication without deadlocking
a worker-thread stop() call.

awake() also checks `_stopping && !_skip_shutdown` under the mutex and
raises RuntimeError in the permanently-stopped case. `_skip_shutdown`
keeps the legitimate `_before_fork()/awake()/_after_fork()` flow
working: the restarted worker consumes the queued AWAKE request.

The worker only notifies the awake waiter on paths where the request
can actually be considered served (AWAKE consumed, or permanent
stop/error/finalization exit). A fork-stop deliberately does not
notify: the pending AWAKE survives for the worker restarted by
`_after_fork()` to serve.

Internal API; no release note.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@r1viollet r1viollet force-pushed the r1viollet/fix-periodic-thread-awake-after-stop branch from 4586038 to dd5488f Compare April 23, 2026 22:00
@r1viollet r1viollet changed the title chore(internal): raise instead of hanging on awake() after stop() chore(internal): make PeriodicThread.awake() non-blocking on stopped threads Apr 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants