You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[test][pipeline-e2e] Shrink MySqlToHudiE2eITCase write volume to fit MOR window
The products workload wrote ~20011 rows across 20 schema evolutions into a
Hudi MERGE_ON_READ table, which could not fully materialize and be read
back within validateSinkResult's 20-minute window (rows stalled and
snapshot reads ballooned as log files piled up), making the test flaky and
the suite hit the 90-minute CI limit. Reduce the per-batch insert count
from 1000 to 100 (~2011 rows total) while keeping all 20 ALTER iterations,
so schema-evolution coverage is unchanged but the table stays small enough
to materialize and read quickly.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Copy file name to clipboardExpand all lines: flink-cdc-e2e-tests/flink-cdc-pipeline-e2e-tests/src/test/java/org/apache/flink/cdc/pipeline/tests/MySqlToHudiE2eITCase.java
+12-7Lines changed: 12 additions & 7 deletions
Original file line number
Diff line number
Diff line change
@@ -310,12 +310,12 @@ public void testSyncWholeDatabase() throws Exception {
310
310
* <ol>
311
311
* <li><b>Column Addition:</b> It sequentially adds 10 new columns, named {@code point_c_0}
312
312
* through {@code point_c_9}, each with a {@code VARCHAR(10)} type. After each column is
313
-
* added, it executes a batch of 1000 {@code INSERT} statements, populating the columns
314
-
* that exist at that point.
313
+
* added, it executes a batch of {@code statementBatchCount} {@code INSERT} statements,
314
+
* populating the columns that exist at that point.
315
315
* <li><b>Column Modification:</b> After all columns are added, it enters a second phase. In
316
-
* each of the 10 iterations, it first inserts another 1000 rows and then modifies the
317
-
* data type of the first new column ({@code point_c_0}), progressively increasing its
318
-
* size from {@code VARCHAR(10)} to {@code VARCHAR(19)}.
316
+
* each of the 10 iterations, it first inserts another {@code statementBatchCount} rows
317
+
* and then modifies the data type of the first new column ({@code point_c_0}),
318
+
* progressively increasing its size from {@code VARCHAR(10)} to {@code VARCHAR(19)}.
319
319
* </ol>
320
320
*
321
321
* <p>Throughout this process, the method constructs and returns a list of strings. Each string
0 commit comments