Skip to content

wip: Pathways proxy and jax client shared memory#1343

Closed
samos123 wants to merge 5 commits into
apple:mainfrom
samos123:pathways-shared-mem
Closed

wip: Pathways proxy and jax client shared memory#1343
samos123 wants to merge 5 commits into
apple:mainfrom
samos123:pathways-shared-mem

Conversation

@samos123
Copy link
Copy Markdown
Contributor

@samos123 samos123 commented Sep 18, 2025

Steps to build custom wheel:

git clone https://github.com/samos123/xla --branch v0.5.3-pw-shared-memory
# a typo 30 vs 3 but just use 30 for now
git clone https://github.com/samos123/jax --branch v0.5.30-pw-shared-memory

cd jax

docker build -f Dockerfile.build -t jax-builder .

docker run --rm -it -v $(pwd)/dist:/build/dist -v $(pwd):/build/jax -v $HOME/xla:/build/xla jax-builder bash
cd jax
python build/build.py build --wheels=jaxlib --local_xla_path=../xla --python_version=3.10 --clang_path=/usr/bin/clang-18
exit

ls dist/

Comment thread axlearn/cloud/gcp/pathways_utils.py Outdated
# The docker image used by pathways proxy container.
_PATHWAYS_PROXY_IMAGE = (
f"us-docker.pkg.dev/cloud-tpu-v2-images/pathways/proxy_server:{_PATHWAYS_IMAGE_TAG}"
"us-docker.pkg.dev/cloud-tpu-v2-images-dev/pathways/gke/shauryag/"
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note this image won't be accessible, will be updated once Shaurya provides it.

@samos123 samos123 force-pushed the pathways-shared-mem branch 5 times, most recently from d80d842 to d4c0fc4 Compare September 19, 2025 02:25
Also improves array_serialization to provide better prformance

add logs to time GCS download and device_puts
@samos123 samos123 closed this Sep 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant