Skip to content

feat: Test TaskGroupWithTimeout - #283

Open
Jim-0518 wants to merge 4 commits into
devfrom
tpu-obs/user/jim/CI_test_for_TaskGroupWithTimeout
Open

feat: Test TaskGroupWithTimeout#283
Jim-0518 wants to merge 4 commits into
devfrom
tpu-obs/user/jim/CI_test_for_TaskGroupWithTimeout

Conversation

@Jim-0518

@Jim-0518 Jim-0518 commented Jun 23, 2026

Copy link
Copy Markdown

Description

Summary of Context & Issue

Unit tests cannot accurately simulate continuous time-budget depletion across consecutive TaskGroups or verify Airflow's state machine behavior during timeout failures.
A integration DAG is needed to validate the TaskGroupWithTimeout component under runtime conditions.

Changes

  1. Integration DAG: Added test_task_group_with_timeout as an end-to-end testing sandbox.
  2. Static Parsing Defenses: Added try...except blocks with AirflowException. Validates that the component successfully blocks nested groups and dynamic mapping during file loading.
  3. Budget Depletion Verification: Configured sequential TaskGroups with workloads to prove the component accurately tracks and depletes the shared execution time pool.
  4. Teardown Flow Orchestration: Placed the cleanup task outside the group using .as_teardown().

Checklist

Before submitting this PR, please make sure (put X in square brackets):

  • I have performed a self-review of my code.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run one-shot tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed.

Jim-0518 and others added 3 commits June 18, 2026 08:37
During GitHub Actions (CI) pipeline execution, native Airflow methods and cloud-dependent functions cause blocking errors due to the lack of an active database connection or cloud permissions.
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 5 times, most recently from d242c8d to f76e189 Compare July 3, 2026 08:25
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 4 times, most recently from a577785 to 71b8d8a Compare July 14, 2026 03:12
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 4 times, most recently from b588728 to 0e938b1 Compare July 23, 2026 01:43
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 2 times, most recently from 54f9a78 to 8e4ea82 Compare July 27, 2026 07:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants