Skip to content

Support legacy pipe receiver requests#17901

Merged
jt2594838 merged 7 commits into
apache:masterfrom
Caideyipi:pipe-receiver-compat-13-sink-pr
Jun 11, 2026
Merged

Support legacy pipe receiver requests#17901
jt2594838 merged 7 commits into
apache:masterfrom
Caideyipi:pipe-receiver-compat-13-sink-pr

Conversation

@Caideyipi

@Caideyipi Caideyipi commented Jun 10, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Summary

  • Treat 1.3 pipe snapshot seal requests without tree/table capture flags as tree-model captures.
  • Use shared capture-flag helpers in DataNode and ConfigNode receivers.
  • Reuse raw tablet parsing for V1 batch tablet requests so 2.0 receivers can parse 1.3 Tablet serialization without column categories.
  • Add coverage for legacy raw tablet and multi-tablet batch payloads.

Tests

  • mvn -Ddevelocity.off=true spotless:apply -pl iotdb-core/node-commons,iotdb-core/datanode,iotdb-core/confignode
  • mvn -Ddevelocity.off=true -DskipTests compile -pl iotdb-core/node-commons
  • mvn -Ddevelocity.off=true spotless:apply -pl iotdb-core/datanode
  • mvn -Ddevelocity.off=true test -pl iotdb-core/datanode -Dtest=PipeDataNodeThriftRequestTest (blocked at existing datanode compile errors in generated aggregation code: missing ComparatorChain/getModeMapSizeThreshold)
  • mvn -Ddevelocity.off=true test -pl iotdb-core/datanode -am -Dtest=PipeDataNodeThriftRequestTest -Dsurefire.failIfNoSpecifiedTests=false (same datanode generated aggregation compile blocker)

@Caideyipi Caideyipi changed the title Support legacy pipe snapshot seal parameters Support legacy pipe receiver requests Jun 10, 2026
Caideyipi added 3 commits June 10, 2026 18:09
@Caideyipi
Resolve legacy pipe tablet request conflicts
26d8cb9
@Caideyipi
Merge pipe memory optimization into legacy compatibility branch
1a6a6ac 
# Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/sink/payload/evolvable/request/PipeTransferTabletRawReq.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/sink/util/TabletStatementConverter.java
#	iotdb-core/datanode/src/test/java/org/apache/iotdb/db/pipe/sink/PipeDataNodeThriftRequestTest.java
@Caideyipi
Add pipe receiver 1.3 compatibility tests
bd8cbee
jt2594838
jt2594838 approved these changes Jun 11, 2026
View reviewed changes
Comment thread ...n/java/org/apache/iotdb/db/pipe/sink/payload/evolvable/request/PipeTransferTabletRawReq.java
@jt2594838 jt2594838 merged commit e7bc492 into apache:master Jun 11, 2026
61 of 62 checks passed
@jt2594838 jt2594838 deleted the pipe-receiver-compat-13-sink-pr branch June 11, 2026 09:25
MileaRobertStefan pushed a commit to MileaRobertStefan/iotdb that referenced this pull request Jun 26, 2026
@Caideyipi @robertMileaNi
Support legacy pipe receiver requests (apache#17901)
1647ded 
* Support legacy pipe snapshot seal parameters

* Support legacy pipe tablet requests

* Resolve legacy pipe tablet request conflicts

* Add pipe receiver 1.3 compatibility tests

* Try current raw tablet format first

* Fix legacy raw tablet fallback
JackieTien97 pushed a commit that referenced this pull request Jun 29, 2026
@Caideyipi @JackieTien97
Support legacy pipe receiver requests (#17901)
5282774 
* Support legacy pipe snapshot seal parameters

* Support legacy pipe tablet requests

* Resolve legacy pipe tablet request conflicts

* Add pipe receiver 1.3 compatibility tests

* Try current raw tablet format first

* Fix legacy raw tablet fallback
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jt2594838 jt2594838 jt2594838 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Caideyipi @jt2594838