Commit dc0d00c
committed
feat: add local LLM installation option with H100 GPU support
- Add Step 4.5: Local LLM Installation (Optional) to setup guide
- Implement H100 GPU resource checking (4x ideal, 1x minimum)
- Add NVIDIA API catalog navigation guide
- Implement automatic deployment strategy (local vs cloud fallback)
- Add Docker Compose integration for local NIM installation
- Auto-configure .env based on deployment choice
- Support multi-GPU configuration (1-4 H100 GPUs)
- Add verification and health checks for local installation1 parent 8176fc2 commit dc0d00c
1 file changed
Lines changed: 707 additions & 229 deletions
0 commit comments