Skip to content

Commit 8a1a77e

Browse files
Add overview sections to setup and PyTorch fine-tuning guides; update notice in testing guide
1 parent 5494b76 commit 8a1a77e

3 files changed

Lines changed: 6 additions & 2 deletions

File tree

content/learning-paths/laptops-and-desktops/pytorch-finetuning-on-spark/1-setup.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,8 @@ weight: 2
66
layout: learningpathall
77
---
88

9+
## Overview
10+
911
The NVIDIA DGX Spark pairs an Arm-based Grace CPU with a Blackwell GPU in a compact desktop form factor. The GPU handles the compute-intensive training passes while the Grace CPU manages data preprocessing and orchestration, making the system well suited for fine-tuning large language models locally without sending data to the cloud.
1012

1113
To get started, you'll configure Docker, pull a pre-built PyTorch container, and install the libraries you need for fine-tuning.
@@ -81,7 +83,7 @@ These packages serve specific purposes:
8183
- `trl` (Transformer Reinforcement Learning) includes training utilities and recipes for language models
8284
- `bitsandbytes` enables 4-bit and 8-bit quantization for memory-efficient training
8385

84-
The installation typically takes a few minutes as pip downloads and installs each package along with their dependencies.
86+
The installation can take a few minutes as pip downloads and installs each package along with their dependencies.
8587

8688
## Authenticate with Hugging Face
8789

content/learning-paths/laptops-and-desktops/pytorch-finetuning-on-spark/3-pytorch.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,8 @@ weight: 4
66
layout: learningpathall
77
---
88

9+
## Overview
10+
911
Now that you understand how fine-tuning works, it's time to look at the actual code. In this section, you'll walk through the key parts of the `Llama3_3B_full_finetuning.py` script and run it with the Raspberry Pi dataset to produce your own fine-tuned Llama model.
1012

1113

content/learning-paths/laptops-and-desktops/pytorch-finetuning-on-spark/4-testing.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -110,7 +110,7 @@ The base model confidently reports the RP2350 has "256MB of memory," which is of
110110

111111
Now test your fine-tuned model to see how training on Raspberry Pi datasheet content improved its factual accuracy. Stop the current vLLM server (press Ctrl+C in the container terminal) before launching the fine-tuned model.
112112

113-
{{% notice Dependency Conflict %}}
113+
{{% notice Note %}}
114114
As of this writing, vLLM does not support version 5 of the `transformers` library that was used when fine-tuning the model, so you need to patch its `tokenizer_config.json`. Run the following command to update the `tokenizer_class` to `PreTrainedTokenizerFast`, which is compatible with the older `transformers` version bundled in the vLLM container:
115115

116116
```bash

0 commit comments

Comments
 (0)