Skip to content

HDFS-17905. Clean up pendingDNMessages on block removal#8415

Merged
ZanderXu merged 1 commit intoapache:trunkfrom
kokonguyen191:pending-msg-leak
Apr 21, 2026
Merged

HDFS-17905. Clean up pendingDNMessages on block removal#8415
ZanderXu merged 1 commit intoapache:trunkfrom
kokonguyen191:pending-msg-leak

Conversation

@kokonguyen191
Copy link
Copy Markdown
Contributor

Description of PR

Since DNs do not report deleted blocks to NNs, in standby and observer namenodes, if not removed, pendingDNMessages will never drain messages from blocks that have already been deleted, leading to a leak.

image

The solution is to clean up the messages when the block is removed in BlockManager#removeBlock().

How was this patch tested?

UT

Copy link
Copy Markdown
Contributor

@ZanderXu ZanderXu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch. LGTM + 1.

Please take a look at Jenkins

@ZanderXu
Copy link
Copy Markdown
Contributor

Merged. Thanks @kokonguyen191 for your contribution.

@ZanderXu ZanderXu merged commit b143491 into apache:trunk Apr 21, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants