[Perf] Cache adstack-sizer metadata per task across SPIR-V + LLVM-GPU; per-snode / DeviceAllocation invalidation (Part 2/2) by duburcqa · Pull Request #620 · Genesis-Embodied-AI/quadrants

[Perf] Cache adstack-sizer metadata per task across SPIR-V + LLVM-GPU; per-snode / DeviceAllocation invalidation

duburcqa

committed

[Fixup] Bump ndarray_data_gen on host-side ndarray writes + fill so cached adstack-sizer metadata is evicted

duburcqa

committed

[Fixup] Erase ndarray_data_gen on Ndarray destroy + parametrize cache-invalidation test over qd.ndarray and field

duburcqa

committed

[Fixup] Promote adstack overflow detection to always-on across SPIR-V task-end emit + LLVM lazy-claim atomic_or

duburcqa

committed

[Fixup] Per-launch adstack overflow poll + dual-cause error message (DLPack-bypass + Quadrants-bug)

duburcqa

committed

[Docs] Document always-on adstack overflow detection + DLPack-bypass cause + per-task cache invalidation contract

duburcqa

committed

[Test] Parametrize teardown-no-double-raise test with force_sync; route via pytest.raises/nullcontext

duburcqa

committed

[Fixup] Phase 1: enriched adstack overflow diagnostic - registry-id cmpxchg + kernel/task name in raise message

duburcqa

committed

[Test] C++ unit tests for Program::diagnose_adstack_overflow_message + registry

duburcqa

committed

[Fixup] Phase 1.1: sync sizer rerun on diagnose; Phase 2.2 host-read polls; SPIR-V routes raise through diagnose helper

duburcqa

committed

[Fixup] Drop sync sizer rerun deref of dangling ad_stack_ptr; registry stays pure-metadata

duburcqa

committed

[Fixup] Restore sync sizer rerun on diagnose; fix dangling ad_stack_ptr by rebinding at every launch

duburcqa

committed

[Fixup] Make adstack registry self-contained: store size_exprs inline; drop backend-tag deref

duburcqa

committed

[Fixup] SPIR-V codegen bakes registry-id cmpxchg into AdStackOverflow[1] via per-task AdStackTaskRegistryId buffer

duburcqa

committed

[Fixup] Auto-invalidate adstack-sizer caches on overflow when sync rerun did not confirm Quadrants-bug; recovery test

duburcqa

committed

[Docs] Tighten autodiff.md cache + adstack overflow sections; restore loop-bound mutation bullet scope

duburcqa

committed

[Fixup] Reflow comments to 120-col budget; drop unit-test reference in program.h

duburcqa

committed

[Fixup] Windows-portable atomic exchange; arr_reads kNone-h2d bump; clean QuadrantsAssertionError on SPIR-V; per-task-only invalidation

duburcqa

committed

[Fixup] Wrap qd.sync() exceptions through handle_exception_from_cpp; pin tests on QuadrantsAssertionError

duburcqa

committed

[Fixup] Resolve ndarray-bound size_expr leaves at diagnose via Device::map; show real required sizes instead of [?]

duburcqa

committed

[Fixup] Reword test_adstack_overflow_diagnostic_and_auto_recovery comment to user-facing phrasing

duburcqa

committed

[Fixup] Tighten confirmed_invalid_cache to DLPackBypass only; Unknown no longer auto-invalidates the cache

duburcqa

committed

[Refactor] Move adstack-overflow registry + diagnose classifier + launch snapshot from Program into AdStackCache

duburcqa

committed

[Perf] Drop redundant per-launch update_adstack_sizing_info_size_exprs + use find() over operator[] in arr_reads kNone bump

duburcqa

committed

[Perf] Fast-skip size_expr cache replay when snode_write_gen / ndarray_data_gen unchanged

duburcqa

committed

[Perf] Skip per-launch SPIR-V adstack-info re-registration once registry_id is set

duburcqa

committed

[Perf] Defer diagnose-snapshot capture to overflow path on LLVM; drop now-unneeded snapshot mutex

duburcqa

committed

[Docs] Clarify adstack overflow polling timing (CPU vs GPU); user-guide tweaks

duburcqa

committed

[Docs] Spell out the file-a-bug flow for sizer under-estimate (clear /tmp/ir/ + QD_DUMP_IR=1 + attach to issue)

duburcqa

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Cache adstack-sizer metadata per task across SPIR-V + LLVM-GPU; per-snode / DeviceAllocation invalidation (Part 2/2)#620

[Perf] Cache adstack-sizer metadata per task across SPIR-V + LLVM-GPU; per-snode / DeviceAllocation invalidation (Part 2/2)#620
duburcqa merged 29 commits into
mainfrom
duburcqa/perf_adstack_metadata_cache

Commits on May 5, 2026

[Perf] Cache adstack-sizer metadata per task across SPIR-V + LLVM-GPU; per-snode / DeviceAllocation invalidation

[Fixup] Bump ndarray_data_gen on host-side ndarray writes + fill so cached adstack-sizer metadata is evicted

[Fixup] Erase ndarray_data_gen on Ndarray destroy + parametrize cache-invalidation test over qd.ndarray and field

[Fixup] Promote adstack overflow detection to always-on across SPIR-V task-end emit + LLVM lazy-claim atomic_or

[Fixup] Per-launch adstack overflow poll + dual-cause error message (DLPack-bypass + Quadrants-bug)

[Docs] Document always-on adstack overflow detection + DLPack-bypass cause + per-task cache invalidation contract

[Test] Parametrize teardown-no-double-raise test with force_sync; route via pytest.raises/nullcontext

[Fixup] Phase 1: enriched adstack overflow diagnostic - registry-id cmpxchg + kernel/task name in raise message

[Test] C++ unit tests for Program::diagnose_adstack_overflow_message + registry

[Fixup] Phase 1.1: sync sizer rerun on diagnose; Phase 2.2 host-read polls; SPIR-V routes raise through diagnose helper

[Fixup] Drop sync sizer rerun deref of dangling ad_stack_ptr; registry stays pure-metadata

[Fixup] Restore sync sizer rerun on diagnose; fix dangling ad_stack_ptr by rebinding at every launch

[Fixup] Make adstack registry self-contained: store size_exprs inline; drop backend-tag deref

[Fixup] SPIR-V codegen bakes registry-id cmpxchg into AdStackOverflow[1] via per-task AdStackTaskRegistryId buffer

[Fixup] Auto-invalidate adstack-sizer caches on overflow when sync rerun did not confirm Quadrants-bug; recovery test

[Docs] Tighten autodiff.md cache + adstack overflow sections; restore loop-bound mutation bullet scope

[Fixup] Reflow comments to 120-col budget; drop unit-test reference in program.h

[Fixup] Windows-portable atomic exchange; arr_reads kNone-h2d bump; clean QuadrantsAssertionError on SPIR-V; per-task-only invalidation

[Fixup] Wrap qd.sync() exceptions through handle_exception_from_cpp; pin tests on QuadrantsAssertionError

[Fixup] Resolve ndarray-bound size_expr leaves at diagnose via Device::map; show real required sizes instead of [?]

[Fixup] Reword test_adstack_overflow_diagnostic_and_auto_recovery comment to user-facing phrasing

[Fixup] Tighten confirmed_invalid_cache to DLPackBypass only; Unknown no longer auto-invalidates the cache

[Refactor] Move adstack-overflow registry + diagnose classifier + launch snapshot from Program into AdStackCache

[Perf] Drop redundant per-launch update_adstack_sizing_info_size_exprs + use find() over operator[] in arr_reads kNone bump

[Perf] Fast-skip size_expr cache replay when snode_write_gen / ndarray_data_gen unchanged

[Perf] Skip per-launch SPIR-V adstack-info re-registration once registry_id is set

[Perf] Defer diagnose-snapshot capture to overflow path on LLVM; drop now-unneeded snapshot mutex

[Docs] Clarify adstack overflow polling timing (CPU vs GPU); user-guide tweaks

[Docs] Spell out the file-a-bug flow for sizer under-estimate (clear /tmp/ir/ + QD_DUMP_IR=1 + attach to issue)