Skip to content

Commit eec6e52

Browse files
GindaChenJunda Chen
andauthored
Uninstall transformer_engine (#110)
Co-authored-by: Junda Chen <32371474+GindaChen@user.noreply.github.com>
1 parent 30e8c2d commit eec6e52

1 file changed

Lines changed: 4 additions & 0 deletions

File tree

.devcontainer/Dockerfile-vllm

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,10 @@ ENV NVTE_FRAMEWORK=pytorch
1111
COPY vllm-requirements.txt /tmp/requirements.txt
1212
RUN pip install -r /tmp/requirements.txt
1313

14+
# Uninstall the transformer engine that comes with the base image.
15+
# Otherwise it will cause error when importing vLLM (LLAVA models).
16+
RUN pip uninstall -y transformer_engine
17+
1418
# crashes docker?
1519
# RUN pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers
1620

0 commit comments

Comments
 (0)