Skip to content

Commit ee61c8d

Browse files
authored
Merge pull request #284 from NYU-RTS/Amanda-dong-patch-1
update intro
2 parents 300cd39 + 2bf99e7 commit ee61c8d

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

docs/hpc/08_ml_ai_hpc/01_intro.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,4 +4,7 @@ Many people are interested in running ML and/or AI workflows on the HPC resource
44

55
For ML we'll cover two prominent open-source deep learning frameworks, PyTorch and TensorFlow. We'll show how to start with a single GPU example and then show more sophisticated examples.
66

7-
For AI we'll cover how to run a Hugging Face Large Language Model (LLM) and how to fine tune an LLM.
7+
For AI we'll cover how to run a Hugging Face Large Language Model (LLM) and how to fine tune an LLM. Specifically, we provide guides on:
8+
1. LLM Inference: Use the standard Hugging Face transformers library for basic tasks, and also introduce vLLM, a high-throughput serving engine that offers faster inference and an OpenAI-compatible API.
9+
2. vLLM CLI: We provide examples of using the vllm command-line tool to quickly serve models and engage in interactive chat sessions.
10+
3. Fine-tuning LLMs: We provide a practical example of fine-tuning the Gemma model to follow specific instructions. This section compares the original model with our improved version, showing how to achieve better response quality on Torch.

0 commit comments

Comments
 (0)