Skip to content

feat(tpu_observability): Add GKE cluster version manager to automate master and node pool upgrades - #248

Open
yuna-tzeng wants to merge 9 commits into
devfrom
tpu-obs/user/yuna/gke_version_update
Open

feat(tpu_observability): Add GKE cluster version manager to automate master and node pool upgrades #248
yuna-tzeng wants to merge 9 commits into
devfrom
tpu-obs/user/yuna/gke_version_update

Conversation

@yuna-tzeng

Copy link
Copy Markdown

Description

This PR introduces a new utility DAG for GKE cluster version management and includes several updates and formatting fixes across related TPU observability DAGs and utilities.

Tests

Airflow/Composer

  • GCP Composer name: yuna-ml-auto (under GCP project: cloud-ml-auto-solutions)
  • GCP Composer version: 2.13.1

Checklist

Before submitting this PR, please make sure (put X in square brackets):

  • I have performed a self-review of my code.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run one-shot tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed.

Comment thread dags/tpu_observability/utils/node_pool_util.py Outdated
Comment thread dags/tpu_observability/utils/node_pool_util.py Outdated
Comment thread dags/tpu_observability/gke_cluster_version_manager.py
with models.DAG(
dag_id=DAG_ID,
start_date=datetime.datetime(2025, 8, 1),
schedule=None,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I forgot what's Xibin's expectation? run the DAG once a day?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

He only proposed a general idea without specifying any particular format, so we probably need to double-check with him.

@yuna-tzeng
yuna-tzeng force-pushed the tpu-obs/user/yuna/gke_version_update branch from 0dc0deb to 1ba63a9 Compare May 20, 2026 07:10
@yuna-tzeng
yuna-tzeng force-pushed the tpu-obs/user/yuna/gke_version_update branch 2 times, most recently from 461d6bd to 5eb9215 Compare May 22, 2026 03:47
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 3 times, most recently from 83f8b37 to ea29ef3 Compare May 28, 2026 07:44
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 2 times, most recently from f996781 to d3601a9 Compare June 4, 2026 08:06
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 5 times, most recently from cd8b06c to d4c530a Compare June 12, 2026 07:31
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 2 times, most recently from 00a4856 to fdcbae9 Compare June 18, 2026 00:43
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 5 times, most recently from d242c8d to f76e189 Compare July 3, 2026 08:25
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 4 times, most recently from a577785 to 71b8d8a Compare July 14, 2026 03:12
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 4 times, most recently from b588728 to 0e938b1 Compare July 23, 2026 01:43
@alfredyu-cienet
alfredyu-cienet force-pushed the dev branch 2 times, most recently from 54f9a78 to 8e4ea82 Compare July 27, 2026 07:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants