Skip to content

Commit 1ebe264

Browse files
authored
Merge pull request #287 from NYU-RTS/Amanda-dong-patch-3
Refactor AI section with bullet points for clarity
2 parents ee61c8d + 548bb86 commit 1ebe264

1 file changed

Lines changed: 4 additions & 3 deletions

File tree

docs/hpc/08_ml_ai_hpc/01_intro.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@ Many people are interested in running ML and/or AI workflows on the HPC resource
55
For ML we'll cover two prominent open-source deep learning frameworks, PyTorch and TensorFlow. We'll show how to start with a single GPU example and then show more sophisticated examples.
66

77
For AI we'll cover how to run a Hugging Face Large Language Model (LLM) and how to fine tune an LLM. Specifically, we provide guides on:
8-
1. LLM Inference: Use the standard Hugging Face transformers library for basic tasks, and also introduce vLLM, a high-throughput serving engine that offers faster inference and an OpenAI-compatible API.
9-
2. vLLM CLI: We provide examples of using the vllm command-line tool to quickly serve models and engage in interactive chat sessions.
10-
3. Fine-tuning LLMs: We provide a practical example of fine-tuning the Gemma model to follow specific instructions. This section compares the original model with our improved version, showing how to achieve better response quality on Torch.
8+
9+
* **LLM Inference**: Use the standard Hugging Face transformers library for basic tasks, and also introduce vLLM, a high-throughput serving engine that offers faster inference and an OpenAI-compatible API.
10+
* **vLLM CLI**: We provide examples of using the vllm command-line tool to quickly serve models and engage in interactive chat sessions.
11+
* **Fine-tuning LLMs**: We provide a practical example of fine-tuning the Gemma model to follow specific instructions. This section compares the original model with our improved version, showing how to achieve better response quality on Torch.

0 commit comments

Comments
 (0)