Skip to content

Commit 944dc29

Browse files
authored
Mchornyi/tprd 1606/update release docs (#8364)
1 parent de8aa9f commit 944dc29

2 files changed

Lines changed: 17 additions & 15 deletions

File tree

README.md

Lines changed: 9 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -27,11 +27,6 @@
2727
-->
2828
[![License](https://img.shields.io/badge/License-BSD3-lightgrey.svg)](https://opensource.org/licenses/BSD-3-Clause)
2929

30-
>[!WARNING]
31-
>You are currently on the `main` branch which tracks under-development progress
32-
>towards the next release. The current release is version [2.59.1](https://github.com/triton-inference-server/server/releases/latest)
33-
>and corresponds to the 25.07 container release on NVIDIA GPU Cloud (NGC).
34-
3530
# Triton Inference Server
3631

3732
Triton Inference Server is an open source inference serving software that
@@ -61,7 +56,7 @@ Major features include:
6156
- Provides [Backend API](https://github.com/triton-inference-server/backend) that
6257
allows adding custom backends and pre/post processing operations
6358
- Supports writing custom backends in python, a.k.a.
64-
[Python-based backends.](https://github.com/triton-inference-server/backend/blob/main/docs/python_based_backends.md#python-based-backends)
59+
[Python-based backends.](https://github.com/triton-inference-server/backend/blob/r25.08/docs/python_based_backends.md#python-based-backends)
6560
- Model pipelines using
6661
[Ensembling](docs/user_guide/architecture.md#ensemble-models) or [Business
6762
Logic Scripting
@@ -172,10 +167,10 @@ configuration](docs/user_guide/model_configuration.md) for the model.
172167
[Python](https://github.com/triton-inference-server/python_backend), and more
173168
- Not all the above backends are supported on every platform supported by Triton.
174169
Look at the
175-
[Backend-Platform Support Matrix](https://github.com/triton-inference-server/backend/blob/main/docs/backend_platform_support_matrix.md)
170+
[Backend-Platform Support Matrix](https://github.com/triton-inference-server/backend/blob/r25.08/docs/backend_platform_support_matrix.md)
176171
to learn which backends are supported on your target platform.
177172
- Learn how to [optimize performance](docs/user_guide/optimization.md) using the
178-
[Performance Analyzer](https://github.com/triton-inference-server/perf_analyzer/blob/main/README.md)
173+
[Performance Analyzer](https://github.com/triton-inference-server/perf_analyzer/blob/r25.08/README.md)
179174
and
180175
[Model Analyzer](https://github.com/triton-inference-server/model_analyzer)
181176
- Learn how to [manage loading and unloading models](docs/user_guide/model_management.md) in
@@ -189,14 +184,14 @@ A Triton *client* application sends inference and other requests to Triton. The
189184
[Python and C++ client libraries](https://github.com/triton-inference-server/client)
190185
provide APIs to simplify this communication.
191186

192-
- Review client examples for [C++](https://github.com/triton-inference-server/client/blob/main/src/c%2B%2B/examples),
193-
[Python](https://github.com/triton-inference-server/client/blob/main/src/python/examples),
194-
and [Java](https://github.com/triton-inference-server/client/blob/main/src/java/src/main/java/triton/client/examples)
187+
- Review client examples for [C++](https://github.com/triton-inference-server/client/blob/r25.08/src/c%2B%2B/examples),
188+
[Python](https://github.com/triton-inference-server/client/blob/r25.08/src/python/examples),
189+
and [Java](https://github.com/triton-inference-server/client/blob/r25.08/src/java/src/main/java/triton/client/examples)
195190
- Configure [HTTP](https://github.com/triton-inference-server/client#http-options)
196191
and [gRPC](https://github.com/triton-inference-server/client#grpc-options)
197192
client options
198193
- Send input data (e.g. a jpeg image) directly to Triton in the [body of an HTTP
199-
request without any additional metadata](https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_binary_data.md#raw-binary-request)
194+
request without any additional metadata](https://github.com/triton-inference-server/server/blob/r25.08/docs/protocol/extension_binary_data.md#raw-binary-request)
200195

201196
### Extend Triton
202197

@@ -205,7 +200,7 @@ designed for modularity and flexibility
205200

206201
- [Customize Triton Inference Server container](docs/customization_guide/compose.md) for your use case
207202
- [Create custom backends](https://github.com/triton-inference-server/backend)
208-
in either [C/C++](https://github.com/triton-inference-server/backend/blob/main/README.md#triton-backend-api)
203+
in either [C/C++](https://github.com/triton-inference-server/backend/blob/r25.08/README.md#triton-backend-api)
209204
or [Python](https://github.com/triton-inference-server/python_backend)
210205
- Create [decoupled backends and models](docs/user_guide/decoupled_models.md) that can send
211206
multiple responses for a request or not send any responses for a request
@@ -214,7 +209,7 @@ designed for modularity and flexibility
214209
decryption, or conversion
215210
- Deploy Triton on [Jetson and JetPack](docs/user_guide/jetson.md)
216211
- [Use Triton on AWS
217-
Inferentia](https://github.com/triton-inference-server/python_backend/tree/main/inferentia)
212+
Inferentia](https://github.com/triton-inference-server/python_backend/tree/r25.08/inferentia)
218213

219214
### Additional Documentation
220215

docs/introduction/compatibility.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,7 @@
3838

3939
| Triton release version | NGC Tag | Python version | Torch version | TensorRT version | TensorRT-LLM version | CUDA version | CUDA Driver version | Size |
4040
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
41+
| 25.08 | nvcr.io/nvidia/tritonserver:25.08-trtllm-python-py3 | Python 3.12.3 | 2.8.0a0+5228986c39.nv25.5 | 10.11.0.33 | 0.21.0 | 12.9.0.043 | 575.51.03 | 20.49 GB |
4142
| 25.07 | nvcr.io/nvidia/tritonserver:25.07-trtllm-python-py3 | Python 3.12.3 | 2.7.0a0+79aa17489c.nv25.4 | 10.10.0.31 | 0.20.0 | 12.9.0.036 | 575.51.03 | 18.3G |
4243
| 25.06 | nvcr.io/nvidia/tritonserver:25.06-trtllm-python-py3 | Python 3.12.3 | 2.7.0a0+79aa17489c.nv25.4 | 10.10.0.31 | 0.20.0 | 12.9.0.036 | 575.51.03 | 18.3G |
4344
| 25.05 | nvcr.io/nvidia/tritonserver:25.05-trtllm-python-py3 | Python 3.12.3 | 2.7.0a0+7c8ec84dab.nv25.3 | 10.9.0.34 | 0.19.0 | 12.8.1.012 | 570.124.06 | 17G |
@@ -59,7 +60,10 @@
5960

6061
| Triton release version | NGC Tag | Python version | vLLM version | CUDA version | CUDA Driver version | Size |
6162
| --- | --- | --- | --- | --- | --- | --- |
62-
| 25.05 | nvcr.io/nvidia/tritonserver:25.04-vllm-python-py3 | Python 3.12.3 | 0.8.4+c4369543.nv25.5.cu129 | 12.9.0.043 | 575.51.03 | 10G |
63+
| 25.08 | nvcr.io/nvidia/tritonserver:25.08-vllm-python-py3 | Python 3.12.3 | 0.9.2+4ef1e343.nv25.8.post1.cu130 | 12.9.0.043 | 575.51.03 | 8.1G |
64+
| 25.07 | nvcr.io/nvidia/tritonserver:25.07-vllm-python-py3 | Python 3.12.3 | 0.9.0rc1+1958ee56.nv25.6.cu129 | 12.9.0.043 | 575.51.03 | 10G |
65+
| 25.06 | nvcr.io/nvidia/tritonserver:25.06-vllm-python-py3 | Python 3.12.3 | 0.9.0rc1+1958ee56.nv25.6.cu129 | 12.9.0.043 | 575.51.03 | 10G |
66+
| 25.05 | nvcr.io/nvidia/tritonserver:25.05-vllm-python-py3 | Python 3.12.3 | 0.8.4+dc1a3e10.nv25.5.cu129 | 12.9.0.043 | 575.51.03 | 10G |
6367
| 25.04 | nvcr.io/nvidia/tritonserver:25.04-vllm-python-py3 | Python 3.12.3 | 0.8.1+5f4af9e0.nv25.4.cu129 | 12.9.0.036 | 575.51.02 | 10G |
6468
| 25.03 | nvcr.io/nvidia/tritonserver:25.03-vllm-python-py3 | Python 3.12.3 | 0.7.3+04de634a.nv25.3.cu128 | 12.8.1.012 | 570.124.06 | 22G |
6569
| 25.02 | nvcr.io/nvidia/tritonserver:25.02-vllm-python-py3 | Python 3.12.3 | 0.7.0+5e800e3d.nv25.2.cu128 | 12.8.0.038 | 570.86.10 | 22G |
@@ -78,6 +82,9 @@
7882

7983
| Triton release version | ONNX Runtime |
8084
| --- | --- |
85+
| 25.08 | 1.23.0+1d1712fdaf |
86+
| 25.07 | 1.22.0 |
87+
| 25.06 | 1.22.0 |
8188
| 25.05 | 1.22.0 |
8289
| 25.04 | 1.21.0 |
8390
| 25.03 | 1.21.0 |

0 commit comments

Comments
 (0)