File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change 11<!--
2- # Copyright 2022-2023 , NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+ # Copyright 2022-2024 , NVIDIA CORPORATION & AFFILIATES. All rights reserved.
33#
44# Redistribution and use in source and binary forms, with or without
55# modification, are permitted provided that the following conditions
@@ -171,6 +171,14 @@ A future of a unique pointer of `InferResult` object will be returned from
171171`AsyncInfer` function, and the result can be retrieved whenever needed by
172172calling `future.get()`.
173173
174+ > [!Note]
175+ > For
176+ > [decoupled models](https://github.com/triton-inference-server/python_backend/tree/main/examples/decoupled#decoupled-model-examples)
177+ > with multi-part responses we recommend using the example `GetResults`
178+ > function, as demonstrated in
179+ > [square_async_infer.cc](examples/square_async_infer.cc), to ensure the entire
180+ > response from the model is collected.
181+
174182When running inference, Server Wrapper provides three options for the
175183allocation and deallocation of output tensors.
176184
You can’t perform that action at this time.
0 commit comments