Merge branch 'main' into pytorch_ddp

Author: RobJY

.github/workflows/code-quality.yml

@@ -18,7 +18,7 @@ jobs:
       - uses: actions/checkout@v5
 
       - name: Setup Node.js
-        uses: actions/setup-node@v4
+        uses: actions/setup-node@v6
         with:
           node-version: latest
 

.github/workflows/links.yaml

@@ -20,7 +20,7 @@ jobs:
         with:
           version: latest
 
-      - uses: actions/setup-node@v4
+      - uses: actions/setup-node@v6
         with:
           node-version: 22
 

.github/workflows/spellcheck.yaml

@@ -17,6 +17,6 @@ jobs:
       uses: actions/checkout@v5
 
     - name: Spell Check Repo
-      uses: crate-ci/typos@v1.35.5
+      uses: crate-ci/typos@v1.38.1
       with:
         files: docs/**/**/*.md docs/**/**/*.mdx

.github/workflows/update-lockfiles.yml

@@ -15,7 +15,7 @@ jobs:
     steps:
       - uses: actions/checkout@v5
       - name: Set up pixi
-        uses: prefix-dev/setup-pixi@v0.9.0
+        uses: prefix-dev/setup-pixi@v0.9.2
         with:
           run-install: false
 

.helix/config.toml

@@ -0,0 +1,2 @@
+[editor]
+soft-wrap.enable = true

blog/2025-05-02-blog-post.mdx

@@ -1,6 +1,6 @@
 ---
 slug: 2025-05-02-o4-mini
-title: o4-mini is now available!
+title: o4-mini is now available
 authors: [sajid-ali]
 tags: [pythia, genai]
 ---

blog/2025-09-10-blog-post.mdx

@@ -0,0 +1,13 @@
+---
+slug: 2025-09-10-claude
+title: Claude is now available
+authors: [sajid-ali]
+tags: [pythia, genai]
+---
+
+We are pleased to announce that the `claude` (`4.0` and `3.7`) models are now available via Pythia. Here are the overviews for the models:
+https://www.anthropic.com/claude/sonnet, https://www.anthropic.com/claude/opus
+
+<!-- truncate -->
+
+With API keys to access Claude, you can also enable Claude API tools like Claude Code. Refer to this guide for more details: https://portkey.ai/docs/integrations/libraries/claude-code#2-integrate-portkey-with-claude-code

docs/cloud/04_dataproc/03_computation.md

@@ -120,7 +120,7 @@ trino --catalog=hive
 
 ## Using Conda
 
-NYU Dataproc comes with `miniconda3` by default. This can be used to manage Python packages within your filesystem home directory. See [here](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) or [here](../../hpc/06_tools_and_software/04_conda_environments.mdx) for more information on the conda command.
+NYU Dataproc comes with `miniconda3` by default. This can be used to manage Python packages within your filesystem home directory. See [here](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) or [here](../../hpc/06_tools_and_software/06_conda_environments.mdx) for more information on the conda command.
 
 ## Using Jupyter Notebooks
 

docs/genai/01_getting_started/01_intro.mdx

@@ -8,8 +8,12 @@ Welcome to Pythia, the generative AI platform for research workflows. As part of
 - [Access to externally hosted LLMs](../01_getting_started/02_llm_gateway.mdx)
 - [HPC resources for fine tuning LLMs](../../hpc/08_ml_ai_hpc/08_llm_fine_tuning.md)
 
-:::tip[Personal use]
+:::info[Personal use]
 If you want to access NYU provided LLMs for personal use, proceed to https://gemini.google.com/app with your NYU credentials. 
 :::
 
+:::tip[GenAI Library Guide]
+Please visit the NYU Library guide on GenAI tools to understand how you can responsibly and effectively harness these tools for academic research: https://guides.nyu.edu/ai-tools
+:::
+
 For an overview of the capabilities afforded by the LLM gateway, proceed to the next section.

docs/genai/03_external_llms/01_catalogue.md

@@ -2,15 +2,17 @@
 
 We currently facilitate access to the following externally hosted LLMs:
 
-## OpenAI
+## Anthropic (via AWS Bedrock)
+-   Claude Sonnet (4.0 & 3.7)
+-   Claude Opus 4.0
+
+## OpenAI (via Azure OpenAI)
 -   gpt-4o-mini
 -   gpt-4o
 -   o4-mini
 -   text-embedding-3-small
 
-## VertexAI
+## Google (via GCP VertexAI)
 -   gemini-2.5 models (pro, flash, flash-lite)
 -   gemini-2.0 models (flash, flash-lite)
 -   gemini-embedding-001
-
-For a comprehensive list, please [refer to the VertexAI documentation](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models).