Skip to content

Commit 27311af

Browse files
authored
Update 1-overview-and-build.md
1 parent 6e55860 commit 27311af

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

content/learning-paths/servers-and-cloud-computing/vllm-acceleration/1-overview-and-build.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -144,5 +144,8 @@ Processed prompts: 100%|██████████████████
144144
```
145145

146146
{{% notice Note %}}
147-
As CPU support in vLLM continues to mature, manual builds will be replaced by a simple `pip install` flow for easier setup in near future.
147+
As CPU support in vLLM continues to mature, these manual build steps will eventually be replaced by a streamlined pip install workflow for aarch64, simplifying future deployments on Arm servers.
148148
{{% /notice %}}
149+
150+
You have now verified that your vLLM Arm64 build runs correctly and performs inference using Arm-optimized kernels.
151+
Next, you’ll proceed to model quantization, where you’ll compress LLM weights to INT4 precision using llmcompressor and benchmark the resulting performance improvements.

0 commit comments

Comments
 (0)