Skip to content

Commit 5e586bf

Browse files
Merge pull request #2472 from AI-Hypercomputer:vllm_fix
PiperOrigin-RevId: 817239502
2 parents ebb3df9 + 58726c1 commit 5e586bf

2 files changed

Lines changed: 3 additions & 3 deletions

File tree

src/MaxText/examples/grpo_llama3_demo.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -458,7 +458,7 @@ def get_ref_maxtext_model(config):
458458
config_policy = pyconfig.initialize(
459459
[
460460
"",
461-
os.path.join(MAXTEXT_PKG_DIR, "configs", "base.yml"),
461+
f"{HOME}/maxtext/src/MaxText/configs/base.yml",
462462
],
463463
base_output_directory="dummy", # This is not used in Tunix.
464464
run_name="test-tunix-maxtext-llama3.1-8b", # This is not used in Tunix.

src/MaxText/examples/install_tunix_vllm_requirement.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -39,14 +39,14 @@ VLLM_TARGET_DEVICE="tpu" pip install --no-cache-dir --pre \
3939
--find-links https://storage.googleapis.com/libtpu-releases/index.html \
4040
--find-links https://storage.googleapis.com/jax-releases/jax_nightly_releases.html \
4141
--find-links https://storage.googleapis.com/jax-releases/jaxlib_nightly_releases.html \
42-
vllm==0.10.2rc2.dev59+gdcb28a332.tpu
42+
vllm==0.11.1rc1.dev292+g1b86bd8e1.tpu
4343

4444
# Install tpu-commons from the artifact registry
4545
pip install --no-cache-dir --pre \
4646
--index-url https://us-python.pkg.dev/cloud-tpu-images/maxtext-rl/simple/ \
4747
--extra-index-url https://pypi.org/simple/ \
4848
--extra-index-url https://us-python.pkg.dev/ml-oss-artifacts-published/jax/simple/ \
4949
--find-links https://storage.googleapis.com/jax-releases/libtpu_releases.html \
50-
tpu-commons==0.1.1
50+
tpu-commons==0.1.2
5151

5252
pip install numba==0.61.2

0 commit comments

Comments
 (0)