Skip to content

Commit aebab93

Browse files
Update Cassandra learning path content
1 parent c128c29 commit aebab93

4 files changed

Lines changed: 24 additions & 26 deletions

File tree

content/learning-paths/servers-and-cloud-computing/flink-on-gcp/_index.md

Lines changed: 6 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,19 +1,15 @@
11
---
22
title: Deploy Apache Flink on Google Cloud C4A (Arm-based Axion VMs)
3-
4-
draft: true
5-
cascade:
6-
draft: true
73

84
minutes_to_complete: 30
95

10-
who_is_this_for: This learning path is intended for software developers deploying and optimizing Apache Flink workloads on Linux/Arm64 environments, specifically using Google Cloud C4A virtual machines powered by Axion processors.
6+
who_is_this_for: This is an introductory topic for developers deploying and optimizing Apache Flink workloads on Linux/Arm64 environments, specifically using Google Cloud C4A virtual machines powered by Axion processors.
117

128
learning_objectives:
139
- Provision an Arm-based SUSE SLES virtual machine on Google Cloud (C4A with Axion processors)
14-
- Install Apache Flink on a SUSE Arm64 (C4A) instance
15-
- Validate Flink functionality by starting the Flink cluster and running a simple baseline job (e.g., WordCount) on the Arm64 VM
16-
- Benchmark Flink performance using internal JMH-based micro-benchmarks on Arm64 (Aarch64) architecture
10+
- Install and configure Apache Flink on an Arm64 instance
11+
- Validate Flink functionality by starting the cluster and running a baseline job
12+
- Benchmark Flink performance using JMH-based microbenchmarks
1713

1814
prerequisites:
1915
- A [Google Cloud Platform (GCP)](https://cloud.google.com/free) account with billing enabled
@@ -23,7 +19,7 @@ author: Pareena Verma
2319

2420
##### Tags
2521
skilllevels: Introductory
26-
subjects: Databases
22+
subjects: Performance and Architecture
2723
cloud_service_providers: Google Cloud
2824

2925
armips:
@@ -48,7 +44,7 @@ further_reading:
4844

4945
- resource:
5046
title: Flink documentation
51-
link: https://nightlies.apache.org/flink/flink-docs-lts/
47+
link: https://nightlies.apache.org/flink/flink-docs-lts/
5248
type: documentation
5349

5450
- resource:

content/learning-paths/servers-and-cloud-computing/flink-on-gcp/baseline.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -9,10 +9,10 @@ layout: learningpathall
99
## Apache Flink Baseline Testing on GCP SUSE VM
1010
In this section you will perform baseline testing for Apache Flink after installation on a GCP SUSE VM. Baseline testing validates that your installation is correct, the JVM is functioning properly, and Flink’s JobManager/TaskManager can execute jobs successfully.
1111

12-
### Install Maven (Required to Build and Run Flink Jobs)
12+
## Install Maven (Required to Build and Run Flink Jobs)
1313
Before running Flink jobs, ensure that Maven is installed on your VM. Many Flink examples and real-world jobs require Apache Maven to compile Java applications.
1414

15-
### Install Maven
15+
## Install Maven
1616

1717
```console
1818
cd /opt
@@ -46,7 +46,7 @@ Default locale: en, platform encoding: UTF-8
4646
OS name: "linux", version: "5.14.21-150500.55.124-default", arch: "aarch64", family: "unix"
4747
```
4848

49-
### Start the Flink cluster
49+
## Start the Flink cluster
5050

5151
Before launching Flink, open port 8081 in the Google Cloud Firewall Rules so that the Web UI is reachable externally.
5252

@@ -80,7 +80,7 @@ The output is similar to:
8080

8181
`StandaloneSessionClusterEntrypoint` is the JobManager process, and `TaskManagerRunner` is the worker responsible for executing tasks and maintaining state.
8282

83-
### Access the Flink Web UI
83+
## Access the Flink Web UI
8484

8585
In a browser, navigate to `http://<VM_IP>:8081`.
8686

@@ -90,7 +90,7 @@ You should see the Flink Dashboard:
9090

9191
A successfully loaded dashboard confirms the cluster network and UI functionality. This serves as the baseline for network and UI validation.
9292

93-
### Run a simple example job
93+
## Run a simple example job
9494
A basic check is to run the built-in WordCount example:
9595

9696
```console

content/learning-paths/servers-and-cloud-computing/flink-on-gcp/benchmarking.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ layout: learningpathall
1010

1111
This section walks you through running Apache Flink microbenchmarks on a Google Cloud Axion C4A (Arm64) SUSE VM. You will clone the official Flink-benchmarks repository, build the benchmark suite, and run the Remote Channel Throughput Benchmark.
1212

13-
### Clone the repository
13+
## Clone the repository
1414
Clone the official Flink microbenchmarks repository:
1515

1616
```console
@@ -20,7 +20,7 @@ cd flink-benchmarks
2020
```
2121
This repository contains microbenchmarks built using JMH (Java Microbenchmark Harness), widely used for JVM-level performance testing.
2222

23-
### Build the benchmarks with Maven
23+
## Build the benchmarks with Maven
2424
Compile the benchmarks and create the executable JAR:
2525

2626
```console
@@ -37,7 +37,7 @@ After building, the compiled benchmarks.jar files appear under:
3737
flink-benchmarks/target/
3838
```
3939

40-
### Explore the JAR contents
40+
## Explore the JAR contents
4141
Verify that benchmarks.jar was generated:
4242

4343
```console
@@ -88,7 +88,9 @@ RemoteChannelThroughputBenchmark.remoteRebalance ALIGNED thrpt 30 17445.341
8888
RemoteChannelThroughputBenchmark.remoteRebalance DEBLOAT thrpt 30 10536.511 ± 60.121 ops/ms
8989
```
9090

91-
## Understand benchmark metrics
91+
## Understand benchmark metrics
92+
93+
The output from the Remote Channel Throughput benchmark includes several statistical measures that help you interpret Flink's performance on Arm64. Understanding these metrics enables you to assess both the average performance and the consistency of results across multiple iterations.
9294

9395
- Run Count: total benchmark iterations executed, higher count improves reliability.
9496
- Average Throughput: mean operations per second across all iterations.
@@ -97,7 +99,7 @@ RemoteChannelThroughputBenchmark.remoteRebalance DEBLOAT thrpt 30 10536.511
9799
- Min Throughput: the lowest throughput was observed, and it shows worst-case performance.
98100
- Max Throughput: highest throughput observed, shows best-case performance.
99101

100-
### Benchmark summary on Arm64
102+
## Benchmark summary for Arm64
101103
Results from the run on the `c4a-standard-4` (4 vCPU, 16 GB memory) Arm64 VM in GCP (SUSE) are summarized below:
102104

103105
| Benchmark | Mode | Count | Score (ops/ms) | Error (±) | Min | Max | Stdev | CI (99.9%) | Units |

content/learning-paths/servers-and-cloud-computing/flink-on-gcp/installation.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ layout: learningpathall
1010

1111
This section shows you how to install Apache Flink and its required dependencies on a Google Cloud Platform (GCP) SUSE Arm64 virtual machine.
1212

13-
### Update the system and install Java
13+
## Update the system and install Java
1414

1515
```console
1616
sudo zypper refresh
@@ -19,7 +19,7 @@ sudo zypper install -y java-17-openjdk java-17-openjdk-devel
1919
```
2020
This step ensures you have the latest system updates and the Java runtime needed to execute Flink applications.
2121

22-
### Download Apache Flink Binary
22+
## Download Apache Flink Binary
2323
Navigate to /opt (a standard location for system-wide tools) and download the official Flink distribution:
2424

2525
```console
@@ -34,7 +34,7 @@ Flink 2.0.0 introduced Disaggregated State Management architecture, which enable
3434
For best performance on Arm, the [Arm Ecosystem Dashboard](https://developer.arm.com/ecosystem-dashboard/) recommends using Flink ≥ 2.0.0.
3535
{{% /notice %}}
3636

37-
### Extract the archive
37+
## Extract the archive
3838
Untar the archive:
3939

4040
```console
@@ -48,7 +48,7 @@ sudo mv flink-2.1.1 /opt/flink
4848
```
4949
This makes configuration, upgrades, and scripting easier for your Flink installation.
5050

51-
### Configure environment variables
51+
## Configure environment variables
5252
Add Flink to your shell environment:
5353

5454
```console
@@ -70,7 +70,7 @@ source ~/.bashrc
7070
```
7171
Adding Flink to the global PATH lets you use commands like `flink`, `start-cluster.sh`, and `taskmanager.sh` from any terminal.
7272

73-
### Verify the installation
73+
## Verify the installation
7474
To confirm that Flink has been installed correctly, check its version:
7575

7676
```console
@@ -83,4 +83,4 @@ You should see an output similar to:
8383
Version: 2.1.1, Commit ID: 074f8c5
8484
```
8585

86-
Apache Flink is now installed and ready for use.
86+
Apache Flink is now installed and ready for use.

0 commit comments

Comments
 (0)