Skip to content

Commit d9e1d57

Browse files
authored
docs: update README to include note on decoupled model responses (#49)
* update README to include note on decoupled model responses * fix copyright
1 parent 4c250f6 commit d9e1d57

1 file changed

Lines changed: 9 additions & 1 deletion

File tree

server/README.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
<!--
2-
# Copyright 2022-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
# Copyright 2022-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
33
#
44
# Redistribution and use in source and binary forms, with or without
55
# modification, are permitted provided that the following conditions
@@ -171,6 +171,14 @@ A future of a unique pointer of `InferResult` object will be returned from
171171
`AsyncInfer` function, and the result can be retrieved whenever needed by
172172
calling `future.get()`.
173173
174+
> [!Note]
175+
> For
176+
> [decoupled models](https://github.com/triton-inference-server/python_backend/tree/main/examples/decoupled#decoupled-model-examples)
177+
> with multi-part responses we recommend using the example `GetResults`
178+
> function, as demonstrated in
179+
> [square_async_infer.cc](examples/square_async_infer.cc), to ensure the entire
180+
> response from the model is collected.
181+
174182
When running inference, Server Wrapper provides three options for the
175183
allocation and deallocation of output tensors.
176184

0 commit comments

Comments
 (0)