Skip to content

Fix disaggregated prefill/decode RayService for H200 GPU clusters#28

Open
iankouls-aws wants to merge 3 commits into
mainfrom
disaggregated-inference
Open

Fix disaggregated prefill/decode RayService for H200 GPU clusters#28
iankouls-aws wants to merge 3 commits into
mainfrom
disaggregated-inference

fix(rayservice): use ray-llm:latest-py311-cu128 image tag

08f7fdf
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings

The logs for this run have expired and are no longer available.