Skip to content

[doc] add FAQ for Stream Load Broken pipe when syncing large tables via Flink CDC#3598

Merged
JNSimba merged 2 commits intoapache:masterfrom
JNSimba:flink-faq-streamload-broken-pipe
Apr 29, 2026
Merged

[doc] add FAQ for Stream Load Broken pipe when syncing large tables via Flink CDC#3598
JNSimba merged 2 commits intoapache:masterfrom
JNSimba:flink-faq-streamload-broken-pipe

Conversation

@JNSimba
Copy link
Copy Markdown
Member

@JNSimba JNSimba commented Apr 29, 2026

Summary

Add a new FAQ entry to the Flink Doris Connector docs (English/Chinese, dev/4.x) for the I/O exception (java.net.SocketException) ... Broken pipe error that users may encounter when syncing large tables (e.g. Oracle) via Flink CDC.

The FAQ explains the root cause (single Stream Load data volume exceeding the BE-side limit) and lists three mitigations:

  • Increase BE streaming_load_max_mb.
  • Enable Connector batch mode (sink.enable.batch-mode=true).
  • Increase Oracle CDC parallelism with --oracle-conf scan.incremental.snapshot.enabled=true (experimental).

Also references the upstream Flink CDC FAQ for further reading.

Files changed

  • docs/ecosystem/flink-doris-connector/flink-doris-connector.md (English dev)
  • i18n/zh-CN/.../current/ecosystem/flink-doris-connector/flink-doris-connector.md (Chinese dev)
  • versioned_docs/version-4.x/ecosystem/flink-doris-connector/flink-doris-connector.md (English 4.x)
  • i18n/zh-CN/.../version-4.x/ecosystem/flink-doris-connector/flink-doris-connector.md (Chinese 4.x)

@JNSimba JNSimba force-pushed the flink-faq-streamload-broken-pipe branch from 89b8d68 to 2dbc964 Compare April 29, 2026 07:25
@JNSimba JNSimba merged commit d1a42c6 into apache:master Apr 29, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant