Skip to content

Commit b991f64

Browse files
committed
Nifi OPA Authorizer thread exhaustion
1 parent bc2bfc9 commit b991f64

1 file changed

Lines changed: 4 additions & 6 deletions

File tree

modules/ROOT/partials/release-notes/release-26.7.adoc

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -195,12 +195,10 @@ Fixed in https://github.com/stackabletech/airflow-operator/pull/800[airflow-oper
195195

196196
===== Apache NiFi
197197

198-
// TODO(author snippet): no release note was written on nifi-opa-plugin#30 (issue) or #31 (fix PR); wording below is a suggestion drafted from the issue/PR - please confirm.
199-
// TODO(hygiene): the issue nifi-opa-plugin#30 is still OPEN and labelled scheduled-for/26.7.0. The fix (nifi-opa-plugin#31) is merged and labelled release/26.7.0. Close the issue and/or move its label to release/26.7.0.
200-
The NiFi OPA authorizer plugin no longer exhausts system threads under load.
201-
Previously, the plugin created a new HTTP client for every authorization request, which could spawn thousands of native threads under NiFi load and lead to errors such as `EAGAIN` or out-of-memory conditions.
202-
With this release the plugin uses a single shared, pooled HTTP client for OPA authorization requests.
203-
No configuration changes are required, as defaults are provided; the pool can be tuned via the `OPA_HTTP_POOL_SIZE`, `OPA_HTTP_CONNECT_TIMEOUT_MS` and `OPA_HTTP_REQUEST_TIMEOUT_MS` environment variables.
198+
The NiFi OPA authorizer plugin no longer exhausts native threads under load.
199+
Previously, the plugin could create a new HTTP client for each authorization request, spawning large numbers of selector and executor threads under NiFi load and eventually exhausting native threads.
200+
With this release, all OPA authorization requests share a single pooled HTTP client with a fixed-size daemon-thread executor.
201+
Existing deployments need no configuration changes, as defaults are provided; the client is configurable via `OPA_HTTP_POOL_SIZE` (default 32), `OPA_HTTP_CONNECT_TIMEOUT_MS` (default 2000) and `OPA_HTTP_REQUEST_TIMEOUT_MS` (default 5000).
204202
Fixed in https://github.com/stackabletech/nifi-opa-plugin/issues/30[nifi-opa-plugin#30].
205203

206204
[#spark-fixes-26_7_0]

0 commit comments

Comments
 (0)