You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/hpc/08_ml_ai_hpc/01_intro.md
+4-3Lines changed: 4 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,6 +5,7 @@ Many people are interested in running ML and/or AI workflows on the HPC resource
5
5
For ML we'll cover two prominent open-source deep learning frameworks, PyTorch and TensorFlow. We'll show how to start with a single GPU example and then show more sophisticated examples.
6
6
7
7
For AI we'll cover how to run a Hugging Face Large Language Model (LLM) and how to fine tune an LLM. Specifically, we provide guides on:
8
-
1. LLM Inference: Use the standard Hugging Face transformers library for basic tasks, and also introduce vLLM, a high-throughput serving engine that offers faster inference and an OpenAI-compatible API.
9
-
2. vLLM CLI: We provide examples of using the vllm command-line tool to quickly serve models and engage in interactive chat sessions.
10
-
3. Fine-tuning LLMs: We provide a practical example of fine-tuning the Gemma model to follow specific instructions. This section compares the original model with our improved version, showing how to achieve better response quality on Torch.
8
+
9
+
***LLM Inference**: Use the standard Hugging Face transformers library for basic tasks, and also introduce vLLM, a high-throughput serving engine that offers faster inference and an OpenAI-compatible API.
10
+
***vLLM CLI**: We provide examples of using the vllm command-line tool to quickly serve models and engage in interactive chat sessions.
11
+
***Fine-tuning LLMs**: We provide a practical example of fine-tuning the Gemma model to follow specific instructions. This section compares the original model with our improved version, showing how to achieve better response quality on Torch.
0 commit comments