Skip to content

Commit a6df61b

Browse files
crypdickRicardo DecalsvekarsAlannaBurke
authored
New Ray Serve tutorial (#3709)
Adds a new tutorial serving Pytorch models on Ray Serve. --------- Co-authored-by: Ricardo Decal <public@ricardodecal.com> Co-authored-by: Svetlana Karslioglu <svekars@meta.com> Co-authored-by: Alanna Burke <aburke626@gmail.com>
1 parent 6f800e1 commit a6df61b

File tree

8 files changed

+387
-4
lines changed

8 files changed

+387
-4
lines changed

.ci/docker/requirements.txt

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,8 @@ pytorch_sphinx_theme2==0.4.4
2121
# Tutorial dependencies
2222
tqdm==4.66.1
2323
numpy==1.24.4
24+
pydantic>=2.10
25+
fastapi
2426
matplotlib
2527
librosa
2628
torch==2.10
@@ -31,8 +33,8 @@ PyHamcrest
3133
bs4
3234
awscliv2==2.1.1
3335
flask
34-
spacy==3.4.1
35-
ray[tune]==2.52.1
36+
spacy==3.7.1 # Keep this version consistent with the model version in .jenkins/build.sh
37+
ray[serve,tune]==2.52.1
3638
tensorboard
3739
jinja2==3.1.3
3840
pytorch-lightning
@@ -62,6 +64,7 @@ sphinxcontrib.katex
6264
boto3
6365
pandas
6466
requests
67+
aiohttp
6568
scikit-image
6669
scipy==1.11.1
6770
numba==0.57.1

.gitignore

Lines changed: 16 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,8 +8,9 @@ prototype
88
/unstable
99
sg_execution_times.rst
1010

11-
#data things
11+
# Datasets
1212
_data/
13+
data/
1314
advanced_source/images/
1415
advanced_source/data/
1516
beginner_source/.data/
@@ -54,6 +55,7 @@ var/
5455
*.egg-info/
5556
.installed.cfg
5657
*.egg
58+
.git
5759

5860
# PyInstaller
5961
# Usually these files are written by a python script from a template
@@ -111,6 +113,7 @@ celerybeat-schedule
111113

112114
# virtualenv
113115
venv/
116+
.venv/
114117
ENV/
115118

116119
# Spyder project settings
@@ -137,3 +140,15 @@ dictionary.dic
137140

138141
# linters
139142
/.lintbin
143+
144+
# Intermediate tutorial files
145+
beginner_source/*/*_tutorial.md
146+
beginner_source/*/*_tutorial.ipynb
147+
intermediate_source/*/*_tutorial.md
148+
intermediate_source/*/*_tutorial.ipynb
149+
advanced_source/*/*_tutorial.md
150+
advanced_source/*/*_tutorial.ipynb
151+
recipes_source/*/*_tutorial.md
152+
recipes_source/*/*_tutorial.ipynb
153+
prototype_source/*/*_tutorial.md
154+
prototype_source/*/*_tutorial.ipynb

.jenkins/build.sh

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,8 @@ fi
3939
# sudo pip uninstall -y torch torchvision torchaudio torchtext torchdata
4040
# pip3 install torch==2.11.0 torchvision torchaudio --no-cache-dir --index-url https://download.pytorch.org/whl/test/cu130
4141
# Install two language tokenizers for Translation with TorchText tutorial
42-
pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.4.0/en_core_web_sm-3.4.0-py3-none-any.whl
42+
# Note: keep this version consistent with the spacy version in requirements.txt
43+
pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.7.1/en_core_web_sm-3.7.1-py3-none-any.whl
4344

4445
awsv2 -i
4546
awsv2 configure set default.s3.multipart_threshold 5120MB

.lycheeignore

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,3 +15,7 @@ http://localhost:6006
1515

1616
# Ignore local host link from advanced_source/cpp_frontend.rst
1717
https://www.uber.com/blog/deep-neuroevolution/
18+
19+
# Ignore localhost links Serving tutorial
20+
http://localhost:8000
21+
http://127.0.0.1:8000

_static/img/ray-serve.png

17 KB
Loading

0 commit comments

Comments
 (0)