Skip to content

Commit 02b0270

Browse files
committed
docs: add ext_proc timeout requirement to README
Without explicit message_timeout and grpc_service.timeout on the Envoy ext_proc filter, Envoy uses very short defaults that cause timeout errors on large-context streaming requests.
1 parent b3343c0 commit 02b0270

1 file changed

Lines changed: 6 additions & 0 deletions

File tree

README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -48,6 +48,12 @@ kubectl apply -f config/crd/bases/
4848
> As a mandatory requirement, `--namespace` must match the namespace where the
4949
> Gateway resource lives.
5050

51+
> **Timeouts**: The Envoy ext_proc filter requires explicit `message_timeout`
52+
> and `grpc_service.timeout` settings. Without them, Envoy uses very short
53+
> defaults that cause timeout errors on large-context streaming requests
54+
> (where Time To First Token exceeds the default). Set both to `300s` to
55+
> match the HTTPRoute request timeout.
56+
5157
The `GATEWAY_NAME` and `GATEWAY_NAMESPACE` environment variables are used by
5258
the controller reconcilers to set the correct parent ref on HTTPRoutes created
5359
for ExternalModel CRs.

0 commit comments

Comments
 (0)