Skip to content

Commit a3317c6

Browse files
authored
Merge pull request #2696 from odidev/updated_lp
Build a Real-Time Analytics Pipeline with ClickHouse on Google Cloud
2 parents b1af4c2 + 80d29db commit a3317c6

17 files changed

Lines changed: 753 additions & 285 deletions

content/learning-paths/servers-and-cloud-computing/clickhouse-gcp/_index.md

Lines changed: 15 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,19 +1,24 @@
11
---
2-
title: Deploy ClickHouse on Google Cloud C4A Arm virtual machines
2+
title: Build a Real-Time Analytics Pipeline with ClickHouse on Google Cloud Axion (Arm-based C4A VMs)
33

4-
minutes_to_complete: 30
4+
minutes_to_complete: 50
55

66
who_is_this_for: This is an introductory topic for developers deploying and optimizing ClickHouse on Arm-based Linux environments using Google Cloud C4A virtual machines powered by Axion processors, to evaluate ClickHouse performance and behavior on Arm-based infrastructure.
77

88
learning_objectives:
9-
- Provision an Arm-based SUSE SLES virtual machine on Google Cloud using C4A instances powered by Axion processors
10-
- Install and start a ClickHouse server on a SUSE Arm64 (C4A) virtual machine
11-
- Verify ClickHouse functionality by connecting to the server and running basic insert and query operations
12-
- Run baseline ClickHouse performance tests to produce throughput and query latency results for evaluating Arm-based deployments on Google Cloud
9+
- Provision an Arm-based SUSE SLES virtual machine on Google Cloud using C4A (Axion processors)
10+
- Configure Google Cloud Pub/Sub for real-time log ingestion
11+
- Deploy and validate ClickHouse on a SUSE Linux Arm64 (Axion) VM
12+
- Build a streaming ETL pipeline using Apache Beam and Google Dataflow
13+
- Ingest real-time Pub/Sub data into ClickHouse using Dataflow
14+
- Validate end-to-end data flow from Pub/Sub to ClickHouse
15+
- Perform baseline and analytical query benchmarking on ClickHouse running on Arm64
16+
- Measure and report query latency (including p95) on Axion processors
1317

1418
prerequisites:
1519
- A [Google Cloud Platform (GCP)](https://cloud.google.com/free) account with billing enabled
1620
- Basic familiarity with [ClickHouse](https://clickhouse.com/)
21+
- Basic understanding of databases and SQL
1722

1823
author: Pareena Verma
1924

@@ -27,7 +32,10 @@ armips:
2732

2833
tools_software_languages:
2934
- ClickHouse
30-
- clickhouse-benchmark
35+
- Apache Beam
36+
- Google Dataflow
37+
- Google Cloud Pub/Sub
38+
- Python 3.11
3139

3240
operatingsystems:
3341
- Linux

content/learning-paths/servers-and-cloud-computing/clickhouse-gcp/baseline.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
---
22
title: Establish a ClickHouse baseline on Arm
3-
weight: 5
3+
weight: 7
4+
45

56
### FIXED, DO NOT MODIFY
67
layout: learningpathall

0 commit comments

Comments
 (0)