Skip to content

Commit bb9a6fb

Browse files
author
Manan Mangal
committed
Update validation workflows
1 parent 07d2b16 commit bb9a6fb

10 files changed

Lines changed: 15 additions & 9 deletions

.github/workflows/beam_PostCommit_Java_Examples_Flink.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,7 @@ jobs:
8080
- name: run examplesIntegrationTest script
8181
uses: ./.github/actions/gradle-command-self-hosted-action
8282
with:
83-
gradle-command: :runners:flink:1.20:examplesIntegrationTest
83+
gradle-command: :runners:flink:2.2:examplesIntegrationTest
8484
- name: Archive JUnit Test Results
8585
uses: actions/upload-artifact@v7
8686
if: ${{ !success() }}

.github/workflows/beam_PostCommit_Java_Nexmark_Flink.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -102,7 +102,7 @@ jobs:
102102
with:
103103
gradle-command: :sdks:java:testing:nexmark:run
104104
arguments: |
105-
-Pnexmark.runner=:runners:flink:1.20 \
105+
-Pnexmark.runner=:runners:flink:2.2 \
106106
"${{ env.GRADLE_COMMAND_ARGUMENTS }} --streaming=${{ matrix.streaming }} --queryLanguage=${{ matrix.queryLanguage }}" \
107107
- name: run PostCommit Java Nexmark Flink (${{ matrix.streaming }}) script
108108
if: matrix.queryLanguage == 'none'

.github/workflows/beam_PostCommit_Java_PVR_Flink_Batch.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ jobs:
6969
job_name: ["beam_PostCommit_Java_PVR_Flink_Batch"]
7070
job_phrase: ["Run Java_PVR_Flink_Batch PostCommit"]
7171
# every major version
72-
flink_version: ['1.20', '2.0']
72+
flink_version: ['1.20', '2.0', '2.1', '2.2']
7373
timeout-minutes: 240
7474
runs-on: [self-hosted, ubuntu-24.04, highmem]
7575
if: |

.github/workflows/beam_PostCommit_Java_PVR_Flink_Streaming.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ jobs:
6060
job_name: [beam_PostCommit_Java_PVR_Flink_Streaming]
6161
job_phrase: [Run Java Flink PortableValidatesRunner Streaming]
6262
# every major version
63-
flink_version: [ '1.20', '2.0', '2.2']
63+
flink_version: [ '1.20', '2.0', '2.1', '2.2']
6464
if: |
6565
github.event_name == 'workflow_dispatch' ||
6666
github.event_name == 'pull_request_target' ||

.github/workflows/beam_PostCommit_Java_Tpcds_Flink.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -101,5 +101,5 @@ jobs:
101101
with:
102102
gradle-command: :sdks:java:testing:tpcds:run
103103
arguments: |
104-
-Ptpcds.runner=:runners:flink:1.20 \
104+
-Ptpcds.runner=:runners:flink:2.2 \
105105
"-Ptpcds.args=${{env.tpcdsBigQueryArgs}} ${{env.tpcdsInfluxDBArgs}} ${{ env.GRADLE_COMMAND_ARGUMENTS }} --queries=${{env.tpcdsQueriesArg}}" \

.github/workflows/beam_PostCommit_Java_ValidatesRunner_Flink.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -58,7 +58,7 @@ jobs:
5858
job_name: [beam_PostCommit_Java_ValidatesRunner_Flink]
5959
job_phrase: [Run Flink ValidatesRunner]
6060
# every major version
61-
flink_version: ['1.20', '2.0', '2.2']
61+
flink_version: ['1.20', '2.0', '2.1', '2.2']
6262
if: |
6363
github.event_name == 'workflow_dispatch' ||
6464
github.event_name == 'pull_request_target' ||

.github/workflows/beam_PostCommit_XVR_Flink.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ env:
4747
DEVELOCITY_ACCESS_KEY: ${{ secrets.DEVELOCITY_ACCESS_KEY }}
4848
GRADLE_ENTERPRISE_CACHE_USERNAME: ${{ secrets.GE_CACHE_USERNAME }}
4949
GRADLE_ENTERPRISE_CACHE_PASSWORD: ${{ secrets.GE_CACHE_PASSWORD }}
50-
FlinkVersion: 1.20
50+
FlinkVersion: 2.2
5151

5252
jobs:
5353
beam_PostCommit_XVR_Flink:

CHANGES.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,6 +62,7 @@
6262
* Python SDK now supports memory profiling with Memray ([#38853](https://github.com/apache/beam/issues/38853)).
6363
* (Python) Added [Qdrant](https://qdrant.tech/) VectorDatabaseWriteConfig implementation ([#38141](https://github.com/apache/beam/issues/38141)).
6464

65+
6566
## I/Os
6667

6768
* Support for reading from Delta Lake added (Java) ([#38551](https://github.com/apache/beam/issues/38551)).

runners/flink/2.2/build.gradle

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -19,8 +19,8 @@
1919
// Flink 2.2 API changes addressed in this module's source overrides:
2020
// - CheckpointingMode moved (Flink 2.2): org.apache.flink.streaming.api.CheckpointingMode
2121
// is now @Deprecated; canonical path is org.apache.flink.core.execution.CheckpointingMode.
22-
// FlinkExecutionEnvironments.java and FlinkPipelineOptionsTest.java are overridden here
23-
// to use the non-deprecated import.
22+
// FlinkExecutionEnvironments.java, DoFnOperator.java, and FlinkPipelineOptionsTest.java
23+
// are overridden here to use the non-deprecated import.
2424
//
2525
// Flink 2.2 breaking changes that are SQL/cluster-layer only (no runner code change needed):
2626
// - TLS cipher suite default changed (FLINK-39022): JDK 11.0.30+/17.0.18+/21.0.10+/24+

website/www/site/content/en/documentation/runners/flink.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -335,6 +335,11 @@ To find out which version of Flink is compatible with Beam please see the table
335335
<td>beam-runners-flink-2.2</td>
336336
<td>&ge; 2.75.0</td>
337337
</tr>
338+
<tr>
339+
<td>2.1.x</td>
340+
<td>beam-runners-flink-2.1</td>
341+
<td>&ge; 2.75.0</td>
342+
</tr>
338343
<tr>
339344
<td>2.0.x</td>
340345
<td>beam-runners-flink-2.0</td>

0 commit comments

Comments
 (0)