Skip to content

Latest commit

 

History

History
2 lines (2 loc) · 278 Bytes

File metadata and controls

2 lines (2 loc) · 278 Bytes

AI-Inference-On-HPC

A comprehensive framework for multi-node, multi-GPU scalable LLM inference on HPC systems using vLLM and Ollama. Includes distributed deployment templates, benchmarking workflows, and chatbot/RAG pipelines for high-throughput, production-grade AI services