Skip to content

Commit e253cdc

Browse files
Refactor documentation for clarity and consistency: update phrasing, section titles, and formatting in setup and build guides for CPU and GPU versions of llama.cpp
1 parent 684f1cd commit e253cdc

3 files changed

Lines changed: 12 additions & 13 deletions

File tree

content/learning-paths/laptops-and-desktops/dgx_spark_llamacpp/1a_gb10_setup.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -86,7 +86,7 @@ Great! If you have seen this message your system is using Armv9 cores, which are
8686

8787
### Grace CPU specification
8888

89-
The following table gives you more information about the key specifications of the Grace CPU and explains their relevance to quantized LLM inference:
89+
The following table provides more information about the key specifications of the Grace CPU and explains their relevance to quantized LLM inference:
9090

9191
| **Category** | **Specification** | **Description / Impact for LLM Inference** |
9292
|---------------|-------------------|---------------------------------------------|
@@ -99,7 +99,7 @@ The following table gives you more information about the key specifications of t
9999
| NUMA Topology | Single NUMA node (node0: 0–19) | Simplifies memory access pattern for unified memory workloads |
100100
| Security and Reliability | Not affected by Meltdown, Spectre, Retbleed, or similar vulnerabilities | Ensures stable and secure operation for long-running inference tasks |
101101

102-
Its SVE2, BF16, and INT8 matrix multiplication (I8MM) capabilities are what make it ideal for quantized LLM workloads, as these provide a power-efficient foundation for both CPU-only inference and CPUGPU hybrid processing.
102+
Its SVE2, BF16, and INT8 matrix multiplication (I8MM) capabilities are what make it ideal for quantized LLM workloads, as these provide a power-efficient foundation for both CPU-only inference and CPU-GPU hybrid processing.
103103

104104
You can also verify the operating system running on your DGX Spark by using the following command:
105105

@@ -120,7 +120,7 @@ This shows you that your DGX Spark runs on Ubuntu 24.04 LTS, a developer-friendl
120120

121121
Nice work! You've confirmed your operating system is Ubuntu 24.04 LTS, so you can move on to the next step.
122122

123-
## Step 2: Verify the Blackwell GPU and driver
123+
## Step 2: verify the Blackwell GPU and driver
124124

125125
After confirming your CPU configuration, verify that the Blackwell GPU inside the GB10 Grace Blackwell Superchip is available and ready for CUDA workloads by using the following:
126126

@@ -161,7 +161,7 @@ The `nvidia-smi` tool reports GPU hardware specifications and provides valuable
161161
The table below provides more explanation of the `nvidia-smi` output:
162162
| **Category** | **Specification (from nvidia-smi)** | **Description / impact for LLM inference** |
163163
|---------------|--------------------------------------|---------------------------------------------|
164-
| GPU name | NVIDIA GB10 | Confirms the system recognizes the Blackwell GPU integrated into the GraceBlackwell Superchip |
164+
| GPU name | NVIDIA GB10 | Confirms the system recognizes the Blackwell GPU integrated into the Grace Blackwell Superchip |
165165
| Driver version | 580.95.05 | Indicates that the system is running the latest driver package required for CUDA 13 compatibility |
166166
| CUDA version | 13.0 | Confirms that the CUDA runtime supports GB10 (sm_121) and is ready for accelerated quantized LLM workloads |
167167
| Architecture / Compute capability | Blackwell (sm_121) | Supports FP4, FP8, and BF16 Tensor Core operations optimized for LLMs |
@@ -174,7 +174,7 @@ The table below provides more explanation of the `nvidia-smi` output:
174174
Excellent! Your Blackwell GPU is recognized and ready for CUDA workloads. This means your system is set up for GPU-accelerated LLM inference.
175175

176176

177-
## Step 3: Check the CUDA toolkit
177+
## Step 3: check the CUDA toolkit
178178

179179
To build the CUDA version of llama.cpp, the system must have a CUDA toolkit installed.
180180

@@ -210,7 +210,7 @@ At this point, you have verified that:
210210

211211
Your DGX Spark environment is now fully prepared for the next section, where you will build and configure both CPU and GPU versions of llama.cpp, laying the foundation for running quantized LLMs efficiently on the Grace Blackwell platform.
212212

213-
## What have I achieved?
213+
## What you have accomplished
214214

215215
In this entire setup section, you have achieved the following:
216216

content/learning-paths/laptops-and-desktops/dgx_spark_llamacpp/2_gb10_llamacpp_gpu.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -125,7 +125,7 @@ Together, these options ensure that the build targets the Grace Blackwell GPU wi
125125

126126
### Step 4: Validate the CUDA-enabled build
127127

128-
After the build completes successfully, verify that the GPU-enabled binary of *llama.cpp is correctly linked to the NVIDIA CUDA runtime.
128+
After the build completes successfully, verify that the GPU-enabled binary of llama.cpp is correctly linked to the NVIDIA CUDA runtime.
129129

130130
To verify CUDA linkage, run the following command:
131131

content/learning-paths/laptops-and-desktops/dgx_spark_llamacpp/3_gb10_llamacpp_cpu.md

Lines changed: 5 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ In this section, you'll build and test the CPU-only version of llama.cpp, optimi
99

1010
The Grace CPU features Arm Cortex-X925 and Cortex-A725 cores with advanced vector extensions including SVE2, BFloat16, and I8MM. These extensions make the CPU highly efficient for quantized inference workloads, even without GPU acceleration.
1111

12-
### Configure and build the CPU-only version
12+
## Configure and build the CPU-only version
1313

1414

1515
In this session, you will configure and build the CPU-only version of llama.cpp, optimized for the Armv9-based Grace CPU.
@@ -83,8 +83,7 @@ The build output is shown below:
8383
```
8484

8585
After the build finishes, you'll find the CPU-optimized binaries at `~/llama.cpp/build-cpu/bin/`
86-
87-
### Step 2: Validate the CPU-Enabled Build (CPU Mode)
86+
## Validate the CPU-enabled build (CPU mode)
8887

8988
First, validate that the binary was compiled in CPU-only mode and runs correctly on the Grace CPU:
9089

@@ -116,7 +115,7 @@ Here is an explanation of the key flags:
116115
- `-ngl 0` disables GPU offloading (CPU-only execution)
117116
- `-t 20` uses 20 threads (1 per Grace CPU core)
118117

119-
If the build is successful, you will observe smooth model initialization and token generation, with CPU utilization increasing across all cores.
118+
If the build is successful, you will see smooth model initialization and token generation, with CPU utilization increasing across all cores.
120119

121120
To monitor live CPU utilization and power metrics during inference, use `htop`:
122121

@@ -125,7 +124,7 @@ htop
125124
```
126125

127126
The following screenshot shows CPU utilization and thread activity during TinyLlama inference on DGX Spark, confirming full multi-core engagement.
128-
![image2 htop screenshot](htop.png "TinyLlama CPU Utilization")
127+
![htop display showing 20 Grace CPU cores at 75-85% utilization during TinyLlama inference with OpenMP threading alt-text#center](htop.png)](htop.png "TinyLlama CPU Utilization")
129128

130129
The `htop` interface shows:
131130

@@ -138,7 +137,7 @@ The `htop` interface shows:
138137
In htop, press F6 to sort by CPU% and verify load distribution, or press `t` to toggle the tree view, which shows the `llama-cli` main process and its worker threads.
139138
{{% /notice %}}
140139

141-
## What have I accomplished?
140+
## What you have accomplished
142141

143142
In this section you have:
144143
- Built and validated the CPU-only version of llama.cpp.

0 commit comments

Comments
 (0)