Skip to content

Pipe: Optimized the table model writing latency by batching & Fixed the NPE caused by tablet event sorting#16062

Merged
JackieTien97 merged 25 commits into
apache:masterfrom
Caideyipi:try-sender
Jul 31, 2025
Merged

Pipe: Optimized the table model writing latency by batching & Fixed the NPE caused by tablet event sorting#16062
JackieTien97 merged 25 commits into
apache:masterfrom
Caideyipi:try-sender

Conversation

@Caideyipi

@Caideyipi Caideyipi commented Jul 30, 2025

Copy link
Copy Markdown
Collaborator

Description

As the title said.

Test

192.168.130.18 -> 192.168.130.19

Before:
image
image
After:
image
image

Benchmark:
config.zip


This PR has:

  • been self-reviewed.
    • concurrent read
    • concurrent write
    • concurrent read and write
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods.
  • added or updated version, license, or notice information
  • added comments explaining the "why" and the intent of the code wherever would not be obvious
    for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold
    for code coverage.
  • added integration tests.
  • been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR

@Caideyipi Caideyipi changed the title Pipe: Optimized the table model writing latency by batching Pipe: Optimized the table model writing latency by batching & Reordered the tablet event sorting Jul 31, 2025
@Caideyipi Caideyipi changed the title Pipe: Optimized the table model writing latency by batching & Reordered the tablet event sorting Pipe: Optimized the table model writing latency by batching & Fixed the NPE caused by tablet event sorting Jul 31, 2025
# Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/sink/payload/evolvable/batch/PipeTabletEventPlainBatch.java
@JackieTien97 JackieTien97 merged commit 6fd3870 into apache:master Jul 31, 2025
27 checks passed
@Caideyipi Caideyipi deleted the try-sender branch August 1, 2025 01:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants