Merge pull request #193 from NYU-RTS/pytorch_ddp

Pytorch ddp

Author: s-sajid-ali

docs/genai/01_getting_started/01_intro.mdx

@@ -6,7 +6,7 @@ If you're looking to harness Generative AI for administrative or classroom use,
 
 Welcome to Pythia, the generative AI platform for research workflows. As part of the Pythia platform, the following capabilities are offered:
 - [Access to externally hosted LLMs](../01_getting_started/02_llm_gateway.mdx)
-- [HPC resources for fine tuning LLMs](../../hpc/08_ml_ai_hpc/04_llm_fine_tuning.md)
+- [HPC resources for fine tuning LLMs](../../hpc/08_ml_ai_hpc/05_llm_fine_tuning.md)
 
 :::info[Personal use]
 If you want to access NYU provided LLMs for personal use, proceed to https://gemini.google.com/app with your NYU credentials. 

docs/genai/04_how_to_guides/04_llm_fine_tuning.md

@@ -1,3 +1,3 @@
 # Fine tuning
 
-Please look into harnessing RAG before attempting to fine-tune a model. For open-weight models, you can use the HPC cluster to perform LoRA fine-tuning as [described here](../../hpc/08_ml_ai_hpc/04_llm_fine_tuning.md).
+Please look into harnessing RAG before attempting to fine-tune a model. For open-weight models, you can use the HPC cluster to perform LoRA fine-tuning as [described here](../../hpc/08_ml_ai_hpc/05_llm_fine_tuning.md).

docs/hpc/08_ml_ai_hpc/01_intro.md

@@ -1 +1,7 @@
-# Machine Learning on HPC
+# Machine Learning (ML) and Artificial Intelligence (AI) on HPC
+
+Many people are interested in running ML and/or AI workflows on the HPC resources.  To help facilitate this we have created this section that will provide examples of how one might use our resources for ML and AI tasks.
+
+For ML we'll cover two prominent open-source deep learning frameworks, PyTorch and TensorFlow (coming soon).  We'll show how to start with a single GPU example and then show more sophisticated examples. 
+
+For AI we'll cover how to run a Hugging Face Large Language Model (LLM) and how to fine tune an LLM.