Skip to content

Commit eb82a1c

Browse files
authored
[build] downgrade flashinfer to 0.4.1 (#1598)
Signed-off-by: AlpinDale <alpindale@gmail.com>
1 parent 5495210 commit eb82a1c

2 files changed

Lines changed: 3 additions & 3 deletions

File tree

docker/Dockerfile

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -315,8 +315,8 @@ RUN --mount=type=bind,from=build,src=/workspace/dist,target=/aphrodite-workspace
315315
# Install FlashInfer pre-compiled kernel cache and binaries
316316
# https://docs.flashinfer.ai/installation.html
317317
RUN --mount=type=cache,target=/root/.cache/uv \
318-
uv pip install --system flashinfer-cubin==0.5.0 \
319-
&& uv pip install --system flashinfer-jit-cache==0.5.0 \
318+
uv pip install --system flashinfer-cubin==0.4.1 \
319+
&& uv pip install --system flashinfer-jit-cache==0.4.1 \
320320
--extra-index-url https://flashinfer.ai/whl/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.') \
321321
&& flashinfer show-config
322322

requirements/cuda.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,4 +12,4 @@ torchvision==0.24.0 # Required for phi3v processor. See https://github.com/pytor
1212
# https://github.com/facebookresearch/xformers/releases/tag/v0.0.31
1313
# xformers==0.0.32.post1; platform_system == 'Linux' and platform_machine == 'x86_64' # Requires PyTorch >= 2.8
1414
# FlashInfer should be updated together with the Dockerfile
15-
flashinfer-python==0.5.0
15+
flashinfer-python==0.4.1

0 commit comments

Comments
 (0)